{bc}
indeed

Data Engineer (G7)

Department for Work and Pensions (DWP)
London, GBR
Parttime, Fulltime
Onsite
£57,946–£75,664,
Discovered 3 days ago
Azure data engineeringETL/ELT pipeline designPySparkPythonCloud data engineeringData cataloguing and metadata management

Full Job Posting

Role overview

Senior Data Engineer role in DWP's Data Engineering community, leading secure and scalable data solutions.

The data estate supports analysts, data scientists and operational teams with reliable, governed data at scale.

Key responsibilities

  • Lead scalable ETL/ELT pipeline design and development using PySpark and Python.
  • Gather complex stakeholder data requirements and shape datasets for analysis and dashboards.
  • Manage data supply to systems and applications, databases and cross-business extraction scripts.
  • Lead data and platform transformation or migration, setting direction and building team capability.
  • Develop cloud pipelines, products, automation, logging and monitoring.
  • Oversee use of data tracking and cataloguing tools and ensure compliance with business standards.
  • Use Agile practices, version control, automation, testing, deployment and change tracking.

Experience and skills

  • The role seeks expert-level Azure data engineering and ETL/ELT pipeline design experience.
  • Strong knowledge of PySpark and Python is sought.
  • The role calls for technical team leadership, cloud data engineering expertise and experience leading transformation or migration.

Security clearance

  • Candidates must pass Security Check clearance.
  • The posting states a continuous UK residence requirement of at least 3 of the last 5 years, including the 2 immediately preceding years.

Locations

  • Possible locations include Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne and Sheffield.
  • London Caxton House is restricted to existing DWP employees already based at Caxton House and Sanctuary Buildings.
  • Newcastle and Sheffield locations have stated future office moves.

Salary

  • The listed salary range is £57,946–£75,664, with a Civil Service Pension employer contribution of 28.97%.

Working pattern

  • The listed working patterns include flexible working, full-time, job share and part-time.

About Skills England

Skills England works with employers, training providers, local partners and government to identify skills needs and support education, training and employment opportunities.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Department for Work and Pensions (DWP)