{bc}
Apply
indeed

Data Engineer (G7)

Department for Work and Pensions (DWP)
London, GBR
Parttime, Fulltime
Onsite
£57,946–£75,664
Discovered 3 days ago
Data engineeringAzure data engineeringETL/ELT pipeline designPySparkPythonCloud data engineering

Full Job Posting

Role overview

Join DWP's Data Engineering community to lead secure, scalable data solutions that support services used across the UK.

The role supports reliable, well-governed data access for analysts, data scientists and operational teams.

Roles and responsibilities

  • Lead design, development and maintenance of scalable ETL/ELT pipelines using PySpark and Python, and uphold workflow and batch-process standards.
  • Gather complex data requirements, interpret data and shape datasets for analysts' dashboards and insight work.
  • Build and manage data supply to systems and applications, including database management and efficient cross-business extraction scripts.
  • Lead large-scale data and platform transformation or migration, set direction, identify issues and build team capability.
  • Develop cloud data pipelines, products and automation, and implement logging, monitoring and performance assurance.
  • Oversee operational tracking and cataloguing of data and metadata using relevant tools, ensuring compliance with business standards.
  • Lead Agile use of version control, automation, monitoring, testing, deployment and change tracking.

Requirements

  • The job summary seeks expert-level Azure data engineering experience, ETL/ELT pipeline design and technical team leadership.
  • Strong knowledge of PySpark and Python is specified.
  • Candidates must pass Security Check clearance.
  • The posting requires continuous UK residence for at least 3 of the last 5 years, including the 2 immediately preceding years.

Data catalogue examples

  • The description names Google Cloud Data Catalog, AWS Glue Data Catalog, Azure Data Catalog, Informatica Enterprise Data Catalog, Alation and Apache Atlas as examples of cataloguing tools.

Salary and contract

  • Salary range is £57,946–£75,664; the listing refers to a more detailed breakdown for national and London locations.
  • The vacancy is permanent.

Working pattern

  • Flexible working, full-time, job share and part-time patterns are listed.

Locations

  • Possible locations include Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne and Sheffield.
  • London is available only to specified existing DWP employees; some Newcastle and Sheffield locations are due to move in 2027 or 2028.

About Skills England

The posting describes Skills England as a DWP executive agency working with employers, training providers, local partners and government on skills needs and employment opportunities.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Department for Work and Pensions (DWP)

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 3 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 4 days agoFull-time

Data Engineer (G7)

London, GBR

Discovered 5 days agoFull-time