Data Engineer (G7)
Role Overview
Permanent Data Engineer role in DWP Digital; the summary describes the post as Senior Data Engineer.
Lead design and delivery of secure, scalable data solutions that support services used by millions of people.
Help maintain a reliable, well-governed data estate for analysts, data scientists and operational teams.
Three positions are listed; locations include Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle and Sheffield.
Security Check clearance is required.
Key Skills for This Role
Full Job Posting
Role overview
Permanent Data Engineer role in DWP Digital; the summary describes the post as Senior Data Engineer.
Lead design and delivery of secure, scalable data solutions that support services used by millions of people.
Help maintain a reliable, well-governed data estate for analysts, data scientists and operational teams.
Three positions are listed; locations include Birmingham, Blackpool, Coventry, Darlington, Leeds, London, Manchester, Newcastle and Sheffield.
Security Check clearance is required.
Data engineering delivery
- Lead scalable ETL/ELT pipeline design, development and maintenance using PySpark and Python.
- Optimize, validate and standardize team workflows and batch processes.
- Gather complex stakeholder requirements and shape datasets for analysts' insight and dashboards.
- Manage data delivery to multiple systems and applications, including databases, and enable cross-business use.
Technical leadership and transformation
- Lead the team through large-scale data and platform transformation or migration programmes, setting direction and building capability.
- Develop complex cloud pipelines, data products and automation processes.
- Lead logging, monitoring and performance assurance for tools.
Cataloguing and Agile practices
- Oversee tracking and cataloguing tools that follow data and metadata through their lifecycle and support compliance with business standards.
- Lead Agile practices and use version control, automation and monitoring to improve pipelines, testing, deployment and change tracking.
Candidate requirements
- Expert-level Azure data engineering and ETL/ELT pipeline design experience, plus technical team leadership experience.
- Strong PySpark and Python knowledge and deep experience with cloud data engineering toolsets.
- The description lists Google Cloud Data Catalog, AWS Glue Data Catalog, Azure Data Catalog, Informatica Enterprise Data Catalog, Alation and Apache Atlas as cataloguing-tool examples.
- Must pass Security Check clearance and have lived continuously in the UK for at least 3 of the past 5 years, including the immediately preceding 2 years.
Employment and work pattern
The contract is permanent. Working patterns include full-time, part-time, flexible working and job share.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Department for Work and Pensions (DWP)
Data Engineer (G7)
London, GBR
DWP seeks a Senior Data Engineer to lead the design and delivery of secure, scalable data solutions and pipelines. The role requires expert Azure data-engineering experience, ETL/ELT design, Python and PySpark, and techn
Data Engineer (G7)
London, GBR
DWP seeks a Senior Data Engineer to lead secure, scalable data engineering and platform transformation. The role includes designing and maintaining ETL/ELT pipelines, managing data supply and governance, and leading a te
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable Azure data engineering and team delivery. The work includes ETL/ELT pipelines, cloud data platforms, governance, transformation and automation; candidates ne
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable data solutions and strengthen data workflows used across government services. The role requires expert Azure data engineering experience, ETL/ELT pipeline de
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead the design and delivery of secure, scalable data solutions. The role requires expert Azure data engineering experience, ETL/ELT pipeline design and technical team leadership,
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineering specialist to lead delivery of secure, scalable data solutions. You will design and maintain data pipelines, guide a team through transformation, and ensure trusted data is availa
Data Engineer (G7)
London, GBR
DWP is seeking an experienced data engineering leader to design and deliver secure, scalable data solutions. The role leads Azure data engineering, pipeline development, team transformation and data governance, requiring
Data Engineer (G7)
London, GBR
DWP is seeking a senior data engineer to lead secure, scalable data solutions and team delivery. The role requires expert Azure data engineering, ETL/ELT pipeline design, PySpark and Python, alongside technical leadershi
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR
Data Engineer (G7)
London, GBR