Data Engineer (G7)
Role Overview
Senior Data Engineer role in DWP's Data Engineering community, leading secure and scalable data solutions.
The data estate supports analysts, data scientists and operational teams with reliable, governed data at scale.
Key Skills for This Role
Full Job Posting
Role overview
Senior Data Engineer role in DWP's Data Engineering community, leading secure and scalable data solutions.
The data estate supports analysts, data scientists and operational teams with reliable, governed data at scale.
Key responsibilities
- Lead scalable ETL/ELT pipeline design and development using PySpark and Python.
- Gather complex stakeholder data requirements and shape datasets for analysis and dashboards.
- Manage data supply to systems and applications, databases and cross-business extraction scripts.
- Lead data and platform transformation or migration, setting direction and building team capability.
- Develop cloud pipelines, products, automation, logging and monitoring.
- Oversee use of data tracking and cataloguing tools and ensure compliance with business standards.
- Use Agile practices, version control, automation, testing, deployment and change tracking.
Experience and skills
- The role seeks expert-level Azure data engineering and ETL/ELT pipeline design experience.
- Strong knowledge of PySpark and Python is sought.
- The role calls for technical team leadership, cloud data engineering expertise and experience leading transformation or migration.
Security clearance
- Candidates must pass Security Check clearance.
- The posting states a continuous UK residence requirement of at least 3 of the last 5 years, including the 2 immediately preceding years.
Locations
- Possible locations include Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle upon Tyne and Sheffield.
- London Caxton House is restricted to existing DWP employees already based at Caxton House and Sanctuary Buildings.
- Newcastle and Sheffield locations have stated future office moves.
Salary
- The listed salary range is £57,946–£75,664, with a Civil Service Pension employer contribution of 28.97%.
Working pattern
- The listed working patterns include flexible working, full-time, job share and part-time.
About Skills England
Skills England works with employers, training providers, local partners and government to identify skills needs and support education, training and employment opportunities.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Department for Work and Pensions (DWP)
Data Engineer (G7)
London, GBR
DWP seeks a Senior Data Engineer to lead the design and delivery of secure, scalable data solutions and pipelines. The role requires expert Azure data-engineering experience, ETL/ELT design, Python and PySpark, and techn
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable Azure data engineering and team delivery. The work includes ETL/ELT pipelines, cloud data platforms, governance, transformation and automation; candidates ne
Data Engineer (G7)
London, GBR
DWP seeks a Senior Data Engineer to lead secure, scalable data engineering and team delivery. The role requires expert Azure data engineering, ETL/ELT pipeline design and technical leadership, with strong PySpark and Pyt
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable data solutions and strengthen data workflows used across government services. The role requires expert Azure data engineering experience, ETL/ELT pipeline de
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead the design and delivery of secure, scalable data solutions. The role requires expert Azure data engineering experience, ETL/ELT pipeline design and technical team leadership,
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineering specialist to lead delivery of secure, scalable data solutions. You will design and maintain data pipelines, guide a team through transformation, and ensure trusted data is availa
Data Engineer (G7)
London, GBR
DWP is seeking an experienced data engineering leader to design and deliver secure, scalable data solutions. The role leads Azure data engineering, pipeline development, team transformation and data governance, requiring
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable data solutions and team delivery. The role requires expert Azure data engineering, ETL/ELT pipeline design, PySpark and Python, alongside technical leadershi
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR