{bc}
Apply
indeed

Data Engineer (G7)

Department for Work and Pensions (DWP)
London, GBR
Parttime, Fulltime
Onsite
£57,946–£75,664
Discovered 1 weeks ago
Azure data engineeringETL/ELT pipeline designPySparkPythonCloud data engineeringData pipeline development and optimization

Full Job Posting

Role overview

Lead design and delivery of secure, scalable data solutions supporting services used across the UK.

The data estate is intended to be reliable, well governed, and continuously improving for analysts, data scientists, and operational teams.

Data engineering delivery

  • Lead development and maintenance of scalable ETL/ELT pipelines using PySpark and Python, with optimized, validated, standardised workflows and batch processes.
  • Gather complex stakeholder requirements, interpret data, and shape datasets for analysts' dashboards and insight work.
  • Build and manage data supply to multiple systems and applications, including database management and efficient extraction scripts.

Transformation and platform operations

  • Lead large-scale data and platform transformation or migration, set direction, build team capability, and proactively identify issues.
  • Develop complex cloud data pipelines, products, automation, logging, and monitoring, and assure tool performance.
  • Oversee operational tracking and data-cataloguing tools to track data and metadata and comply with business standards.
  • Lead Agile use of version control, automation, and monitoring; streamline pipelines, automate testing and deployment, and track changes.

Skills and experience

  • The role seeks a Senior Data Engineer with expert-level Azure data engineering, ETL/ELT pipeline design, and technical team leadership experience.
  • Strong knowledge of PySpark and Python is specified.
  • Data catalogue examples include Google Cloud Data Catalog, AWS Glue Data Catalog, Azure Data Catalog, Informatica Enterprise Data Catalog, Alation, and Apache Atlas.

Clearance

  • The role requires Security Check clearance.
  • The source states continuous UK residence for at least three of the previous five years, including the two immediately preceding years.

Salary and grade

  • The listed salary range is £57,946–£75,664; the source provides no pay cadence.
  • The listed job grade is Grade 7, and the role is permanent.

Working pattern

  • The source lists flexible working and full-time or part-time working patterns, including job share.

Locations

  • The role may be based in Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne, or Sheffield.
  • London Caxton House is restricted to existing DWP employees already based at Caxton House or Sanctuary Buildings.
  • Newcastle and Sheffield roles have stated future office relocation plans.

Organisation

Skills England is described as a DWP executive agency working with employers, training providers, local partners, and government on skills needs, education, training, and employment.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Department for Work and Pensions (DWP)

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 5 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 5 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 5 days agoFull-time