{bc}
Apply
indeed

Data Engineer (G7)

Department for Work and Pensions (DWP)
London, GBR
Parttime, Fulltime
Onsite
£57,946 to £75,664
Discovered 2 days ago
Azure data engineeringETL/ELT pipeline designPySparkPythonCloud data engineeringDatabase management

Full Job Posting

Role overview

DWP Digital seeks a Senior Data Engineer to lead secure, scalable data solutions used by services across the UK.

The role supports reliable, well-governed data access for analysts, data scientists, and operational teams.

Security Check clearance is required.

Experience and eligibility

  • The posting asks for expert-level Azure data-engineering experience, ETL/ELT pipeline design, and technical team leadership.
  • Strong knowledge of PySpark and Python is specified.
  • Applicants must have resided continuously in the UK for at least three of the last five years, including the two immediately preceding years.
  • Security Check clearance is required.

Data engineering and delivery

  • Lead design, development, and maintenance of scalable ETL/ELT pipelines using PySpark and Python.
  • Optimize, validate, and standardize team workflows and batch processes.
  • Gather complex stakeholder requirements and shape datasets for analysts’ dashboards and insight.
  • Build and manage data supply to multiple systems, including databases and efficient extraction scripts.

Transformation, platforms and governance

  • Lead the team through large-scale data and platform transformation or migration programmes and build capability.
  • Develop complex cloud pipelines, products, and automation processes; lead logging, monitoring, and performance assurance.
  • Oversee operational tracking and cataloguing of data and metadata using tools such as Google Cloud Data Catalog, AWS Glue Data Catalog, Azure Data Catalog, Informatica Enterprise Data Catalog, Alation, or Apache Atlas.
  • Lead Agile use of version control, automation, monitoring, testing, deployment, and change tracking.

Salary

  • The listed salary range is £57,946 to £75,664; a more detailed breakdown by national and London location is referenced in the posting.
  • The role includes a Civil Service Pension with an employer contribution of 28.97%.

Possible locations

  • The role may be based in Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne, or Sheffield.
  • Some London vacancies are restricted to existing DWP employees based at specified London offices.
  • Newcastle and Sheffield roles are expected to move offices by 2027 and 2028 respectively.

Employment and working pattern

The contract is permanent.

Working patterns include flexible working, full-time, job share, and part-time.

Three vacancies are available.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Department for Work and Pensions (DWP)

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time