Senior Data Engineer
Role Overview
Contract data engineering role supporting a UK public-sector project; the role is remote, with UK-based candidates preferred.
Build and improve pipelines, data models, and integration patterns aligned with the organisation’s Target Operating Model for Data.
The hands-on role contributes to scalable data flows and ensures solutions meet technical standards, performance expectations, and security controls.
Key Skills for This Role
Full Job Posting
Role overview
Contract data engineering role supporting a UK public-sector project; the role is remote, with UK-based candidates preferred.
Build and improve pipelines, data models, and integration patterns aligned with the organisation’s Target Operating Model for Data.
The hands-on role contributes to scalable data flows and ensures solutions meet technical standards, performance expectations, and security controls.
Key responsibilities
- Build and maintain ETL pipelines and code in cloud data platforms.
- Support ingestion and onboarding of new data sources.
- Develop data engineering workloads in the Databricks Data Intelligence Platform.
- Construct raw, refined, and curated data layers and catalogue assets.
- Validate solutions against functional and non-functional requirements.
- Deliver datasets, transformations, and performance-optimized data products.
- Improve processes, engineering patterns, and reusable tooling.
- Monitor and measure pipeline performance and support incident resolution.
- Ensure documentation meets acceptance standards and is centrally approved.
- Participate in Agile ceremonies and governance forums.
Mandatory technical requirements
- Strong experience with Python, PySpark, and SQL for data engineering.
- Hands-on Azure Databricks experience; strong knowledge of Azure Data Factory and Microsoft Fabric.
- Experience with Microsoft Purview.
- Familiarity with event-driven ingestion using Event Grid or Pub-Sub.
- Understanding of SOLID principles, asynchronous programming, and Mediator or Factory patterns.
- Experience delivering unit and integration testing in Databricks.
- Knowledge of secure ETL design with Entra IMID/SCIM integration.
- Understanding of Azure best practices, APIM, and platform governance.
- Ability to build and serve Power BI models using Databricks data sources.
Desirable experience
- Prior experience working in UK public-sector environments is desirable.
Working approach
- Strong stakeholder communication and cross-team collaboration.
- Analytical, solution-focused, independent, and able to take ownership and drive progress.
- Committed to clean, scalable, well-documented engineering and adaptable in dynamic delivery environments.
Location and work arrangement
- Remote role; UK-based candidates are preferred.
Contract details
Contract type is stated as Freelance / Contract.
Start date is ASAP.
Candidates must be eligible to work with UK Government departments or meet BPSS requirements.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
