{bc}
indeed

Data Engineer (G7)

Department for Work and Pensions (DWP)
London, GBR
Parttime, Fulltime
Onsite
£57,946–£75,664
Discovered 5 days ago
Azure data engineeringETL/ELT pipeline designPySparkPythonData engineeringData cataloguing and metadata management

Full Job Posting

About the job

DWP Digital seeks a senior data engineer to lead secure, scalable data solutions used to support services across the UK.

The role supports reliable, well-governed data access for analysts, data scientists and operational teams.

Roles and responsibilities

  • Lead scalable ETL/ELT pipeline design, development and maintenance using PySpark and Python.
  • Ensure data workflows and batch processes are optimized, validated and standardized.
  • Gather complex stakeholder data requirements and shape datasets for analysts’ dashboards and insight work.
  • Build and manage data provision to systems and applications, including databases, and enable efficient data extraction.
  • Lead large-scale data and platform transformation or migration, set direction and proactively identify issues.
  • Develop cloud data pipelines, products, automation, logging, monitoring and performance assurance.
  • Oversee operational tracking and cataloguing of data and metadata using tools such as Google Cloud Data Catalog, AWS Glue, Azure Data Catalog, Informatica, Alation or Apache Atlas.
  • Lead Agile use of version control, automation, monitoring, testing, deployment and change tracking.

Requirements

  • The job summary seeks expert-level Azure data engineering and ETL/ELT pipeline design experience and technical team leadership.
  • Strong knowledge of PySpark and Python is specified for data workflows and batch processes.
  • The posting states that Security Check clearance is required.
  • The posting states a UK residence condition: continuous residence for at least 3 of the last 5 years, including the immediately preceding 2 years.

Working pattern

  • The posting lists flexible working, full-time, job share and part-time patterns.

Location

  • The role may be based in Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne or Sheffield.
  • London Caxton House is available only to existing DWP employees already based at Caxton House and Sanctuary Buildings.
  • Newcastle and Sheffield roles have stated temporary office-location arrangements before planned moves.

Salary and benefits

  • The advertised salary range is £57,946–£75,664; the posting refers candidates to a benefits section for location-specific salary details.
  • The posting lists a Civil Service Pension with an employer contribution of 28.97%.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Department for Work and Pensions (DWP)