{bc}
indeed

Data Engineer (G7)

Department for Work and Pensions (DWP)
London, GBR
Parttime, Fulltime
Onsite
Discovered 4 days ago
Azure data engineeringETL/ELT pipeline designPySparkPythonCloud data engineeringData cataloguing and metadata management

Full Job Posting

Role overview

Permanent Grade 7 role in DWP Digital's Data Engineering community; three positions are available.

Lead secure, scalable data solutions that support services used across the UK and enable teams to access trusted data.

The role may be based in Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne, or Sheffield; some London locations are restricted to existing DWP employees.

Requirements and clearance

  • The role calls for expert-level Azure data engineering experience, ETL/ELT pipeline design, and technical team leadership.
  • Strong knowledge of PySpark and Python is sought.
  • Candidates must pass Security Check clearance.
  • Applicants must have lived continuously in the UK for at least three of the last five years, including the immediately preceding two years.

Responsibilities

  • Lead scalable ETL/ELT pipeline design and development, and optimize, validate, and standardize team workflows and batch processes.
  • Gather complex stakeholder data requirements and shape datasets for analysts' analysis and insight dashboards.
  • Build and manage data supply to multiple systems and applications, including databases and efficient cross-business extraction scripts.
  • Lead large-scale data and platform transformation or migration, set direction, identify issues, and build team capability.
  • Develop cloud data pipelines, products, automation, logging, and monitoring; assure tool performance.
  • Oversee operational tracking and data-cataloguing tools, ensuring data and metadata are tracked and business standards are followed.
  • Promote Agile practices, version control, automation, monitoring, testing, deployment, and change tracking.

Locations and working pattern

  • Flexible working, full-time, job-share, and part-time patterns are listed.
  • The description identifies possible office locations but does not specify an onsite, hybrid, or remote policy.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Department for Work and Pensions (DWP)