Data Engineer
Role Overview
Money and Pensions Service is seeking a Data Engineer to design and implement data pipelines connecting operational systems with analytics and business intelligence systems.
The role operates in a cloud-only environment, predominantly using Microsoft Fabric on Azure.
The Data Engineer reports to a Senior Data Engineer and works with Senior Engineers on cloud-based data engineering pipelines and technical data architecture.
Key Skills for This Role
Full Job Posting
Role overview
Money and Pensions Service is seeking a Data Engineer to design and implement data pipelines connecting operational systems with analytics and business intelligence systems.
The role operates in a cloud-only environment, predominantly using Microsoft Fabric on Azure.
The Data Engineer reports to a Senior Data Engineer and works with Senior Engineers on cloud-based data engineering pipelines and technical data architecture.
Compensation
- The salary is approximately £53,000 per annum.
Workplace and employment
- The role is based in Bedford.
- Some hybrid working is possible.
- The position is permanent.
Key responsibilities
- Implement ETL processes to extract, transform, and load data from source systems into reporting solutions.
- Develop and configure metadata-driven data pipelines using Azure Data Factory, Apache Spark, and related tools.
- Monitor pipelines for failures or unusual data profiles and establish recovery processes.
- Use cloud data platforms, data lake storage, and cloud orchestration tools for data storage, processing, and transfer.
- Ensure data solutions are scalable, reliable, secure, and compliant with governance policies.
- Work with data scientists, analysts, and stakeholders to understand requirements and deliver solutions.
- Work within Agile methodology to build clear user stories and work items.
- Deliver thoroughly tested, high-quality code and data products.
- Apply modern data architecture principles such as data lakes, external tables, medallion architecture, and loose coupling.
Required skills and experience
- Demonstrated data engineering experience and ability to work independently following established patterns.
- Experience implementing ETL processes, ideally in an Azure or Microsoft Fabric environment.
- Genuine competence using SQL to query and manipulate data.
- Proficiency in cloud data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Factory, or AWS equivalents.
- Spark, PySpark, or Python skills.
- Excellent problem-solving skills, attention to detail, communication, and collaboration skills.
- Willingness to learn and enthusiasm for cloud technology and data.
- Microsoft Fabric interest, skills, or experience is a bonus.
Data architecture and reporting
- The role requires broad understanding and interest in modern data architecture principles.
- Relevant concepts include data lakes, external tables, medallion architecture, and loose coupling.
- A high-level understanding of reporting tools such as Power BI and the needs of analysts consuming engineered data is relevant.
About Money and Pensions Service
Money and Pensions Service works to help people across the UK improve their financial wellbeing.
The organisation describes its values as caring, connecting, and transforming.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Money and Pensions Service
Lead D365 Power Platform Developer
Bedford, GBR
The employer seeks a Lead D365 Power Platform Developer to lead hands-on solution delivery, engineering standards, integrations, deployments, and a developer community of practice. Extensive Dynamics 365 CE and Power Pla
HR Data and Reporting Analyst
Bedford, GBR
MaPS is seeking an HR Data and Reporting Analyst to maintain workforce data quality and produce reporting and insight for organisational decisions. Candidates need strong HR data and systems experience, Excel and data ma
Senior Business Analyst
Bedford, GBR
The Money and Pensions Service is seeking a Senior Business Analyst for its Digital Product Team, supporting digital self-service products and CRM and CCaaS improvements. The role requires public-sector experience and sk
Research Statistician
Bedford, GBR
The Money and Pensions Service is seeking a Research Statistician to analyse population and survey datasets and produce evidence for strategy, policy, and services. The role uses statistical analysis and modelling and in
Process Governance Analyst
Bedford, GBR
The Money and Pensions Service is seeking a Process Governance Analyst to administer its business-process repository and governance arrangements. The role requires SharePoint and Power Automate workflow experience, BPMN
Partnership Coordinator
Bedford, GBR
The Money and Pensions Service is seeking a Partnership Coordinator to support the Money Guiders programme and its strategic partnerships. The role coordinates documentation, meetings, supplier processes, stakeholder eng
BI Analyst
Bedford, GBR
Money and Pensions Service is seeking a BI Analyst to turn operational and debt-service data into actionable insight. The role covers data acquisition, modelling, statistical analysis, dashboards, reporting and recommend
Lead D365 Power Platform Developer
Bedford, GBR
HR Data and Reporting Analyst
Bedford, GBR
Senior Business Analyst
Bedford, GBR
Research Statistician
Bedford, GBR
Process Governance Analyst
Bedford, GBR
Partnership Coordinator
Bedford, GBR
BI Analyst
Bedford, GBR