{bc}
Apply
indeed

Data Engineer (G7)

Department for Work and Pensions (DWP)
London, GBR
Parttime, Fulltime
Onsite
£57,946–£75,664
Discovered 4 days ago
Azure data engineeringETL/ELT pipeline designPySparkPythonCloud data engineeringData pipeline development

Full Job Posting

Role overview

Join DWP's Data Engineering community to lead secure, scalable data solutions supporting services used across the UK.

The role supports reliable, well-governed data access for analysts, data scientists and operational teams.

The job summary identifies the post as a Senior Data Engineer; the source title includes the grade marker G7.

Responsibilities

  • Lead design, development and maintenance of scalable ETL/ELT pipelines using PySpark and Python.
  • Gather complex requirements from stakeholders and shape datasets for analysts' dashboards and insight.
  • Build and manage data provision to multiple systems and applications, including database management and extraction scripts.
  • Lead large-scale data and platform transformation or migration, setting direction and identifying issues.
  • Develop complex cloud pipelines, products and automation, and lead logging, monitoring and performance assurance.
  • Oversee tools that track data and metadata through their lifecycle, ensuring compliance with business standards.
  • Lead Agile practices for version control, automation, monitoring, testing, deployment and change tracking.

Requirements

  • Expert-level experience in Azure data engineering, ETL/ELT pipeline design and technical team leadership.
  • Strong knowledge of PySpark and Python.
  • Pass Security Check clearance.
  • The posting states a UK residence requirement: continuously resident for at least 3 of the last 5 years, including the 2 immediately preceding years.

Data catalogue examples

  • Examples listed include Google Cloud Data Catalog, AWS Glue Data Catalog, Azure Data Catalog, Informatica Enterprise Data Catalog, Alation and Apache Atlas.

Locations and working pattern

  • Possible locations include Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne and Sheffield.
  • Working patterns include flexible working, full-time, job share and part-time.

Salary and contract

  • Salary range is £57,946–£75,664; consult the benefits section for national and London breakdowns.
  • The role is permanent and offers a Civil Service pension with a stated employer contribution of 28.97%.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Department for Work and Pensions (DWP)

Data Engineer (G7)

London, GBR

Discovered 2 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time