Data Engineer (G7)
Role Overview
Join DWP’s Data Engineering community to lead the design and delivery of secure, scalable data solutions used across UK services.
The role supports reliable, well-governed data access for analysts, data scientists and operational teams.
Key Skills for This Role
Full Job Posting
Role overview
Join DWP’s Data Engineering community to lead the design and delivery of secure, scalable data solutions used across UK services.
The role supports reliable, well-governed data access for analysts, data scientists and operational teams.
Candidate requirements
- The job summary calls for a Senior Data Engineer with expert-level Azure data engineering, ETL/ELT pipeline design and technical team leadership experience.
- Strong knowledge of PySpark and Python is required.
- Security Check clearance is required.
- The posting states that candidates must have resided continuously in the UK for at least three of the last five years, including the two immediately preceding years.
Responsibilities
- Lead design, development and maintenance of scalable ETL/ELT pipelines using PySpark and Python.
- Gather complex stakeholder data requirements and shape datasets for analysts’ dashboards and insights.
- Build and manage data supply across systems and applications, database management and extraction scripts.
- Lead team data and platform transformation or migration programmes.
- Develop cloud data pipelines, products, automation, logging, monitoring and performance assurance.
- Oversee operational data and metadata tracking and cataloguing tools and compliance with business standards.
- Lead Agile practices and engineering tools for version control, automation, monitoring, testing, deployment and change tracking.
Tools and technologies
- The posting names Google Cloud Data Catalog, AWS Glue Data Catalog, Azure Data Catalog, Informatica Enterprise Data Catalog, Alation and Apache Atlas as examples of cataloguing tools.
Locations
- Possible locations are Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne and Sheffield.
- The London Caxton House location is limited to eligible existing DWP employees already based at Caxton House or Sanctuary Buildings.
- Newcastle and Sheffield roles initially use specified existing offices before planned moves by the end of 2027 and early 2028, respectively.
Contract and working pattern
- The position is permanent.
- Working patterns include flexible working, full-time, job share and part-time.
Salary and pension
- Salary is £57,946–£75,664; the posting directs candidates to the benefits section for location-specific details.
- Civil Service Pension with an employer contribution of 28.97%.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Department for Work and Pensions (DWP)
Data Engineer (G7)
London, GBR
DWP seeks a Senior Data Engineer to lead the design and delivery of secure, scalable data solutions and pipelines. The role requires expert Azure data-engineering experience, ETL/ELT design, Python and PySpark, and techn
Data Engineer (G7)
London, GBR
DWP seeks a Senior Data Engineer to lead secure, scalable data engineering and platform transformation. The role includes designing and maintaining ETL/ELT pipelines, managing data supply and governance, and leading a te
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable Azure data engineering and team delivery. The work includes ETL/ELT pipelines, cloud data platforms, governance, transformation and automation; candidates ne
Data Engineer (G7)
London, GBR
DWP seeks a Senior Data Engineer to lead secure, scalable data engineering and team delivery. The role requires expert Azure data engineering, ETL/ELT pipeline design and technical leadership, with strong PySpark and Pyt
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable data solutions and strengthen data workflows used across government services. The role requires expert Azure data engineering experience, ETL/ELT pipeline de
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead the design and delivery of secure, scalable data solutions. The role requires expert Azure data engineering experience, ETL/ELT pipeline design and technical team leadership,
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineering specialist to lead delivery of secure, scalable data solutions. You will design and maintain data pipelines, guide a team through transformation, and ensure trusted data is availa
Data Engineer (G7)
London, GBR
DWP is seeking an experienced data engineering leader to design and deliver secure, scalable data solutions. The role leads Azure data engineering, pipeline development, team transformation and data governance, requiring
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR