Senior Data Engineer - Azure Databricks Platform
Full Job Posting
Role & Responsibilities
- The role will be responsible for taking technical ownership of key workstreams on EnerMech's Azure Databricks data platform, operating across the full platform stack: data modelling and pipeline development in Databricks, the underlying Azure infrastructure, and the CI/CD, DevOps and DataOps practices that keep the platform reliable, secure and scalable.
- The role holder operates with a high degree of autonomy, makes and documents architectural decisions, resolves complex platform issues, and is a technical point of contact for the global EBS Team, and business stakeholders.
- This is a fully remote role in the UK,supporting our Enterprise Business Systems (EBS) function in the Mumbai Shared Service Centre.
- Key reponsibilities will include:
- Design, build, quality and reliable operation of assigned workstreams on the Azure Databricks data platform, from scoping through to production deployment.
- Integrity of the medallion data model (bronze/silver/gold) for assigned data domains, ensuring data is modelled, validated, documented and certified for downstream reporting and analytics.
- Build and optimise Delta tables and materialized views, with attention to performance at scale.
- Design and implement data quality frameworks (preferably DQX or equivalent), including quarantine/error handling and validation against data contracts.
- Define job-specific compute configurations appropriate to each workload, balancing performance and cost.
- Contribute to and troubleshoot Terraform-managed infrastructure (networking, storage, Key Vaults, Managed DevOps Pools, Dev Centers).
- Own and maintain Azure DevOps build and release pipelines, variable groups/libraries, and repository security, permissions and branch policies.
- Support environment-level Azure configuration, including subscription-level access, RBAC for user and pipeline (service principal) identities, and Terraform state backend management across multiple storage accounts and environments.
- Operate autonomously across a workstream, from scoping through to production deployment.
- Use AI-assisted tooling to support day-to-day development, validating outputs against authoritative sources (architecture decisions, technical leads, documentation) before acting on them.
- Communicate clearly with technical and non-technical stakeholders, including across time zones with colleagues in the UK, Americas, Middle East and Asia Pacific.
- The Requirements
- Essential
- Bachelor's degree in Computer Science, Engineering, Information Systems or a related discipline, or equivalent practical experience.
- Typically 6+ years in data engineering, including 3+ years hands-on with Azure Databricks in production.
- Demonstrated ownership of medallion architecture design and data modelling.
- Implemented data quality frameworks and data contracts in production.
- Implemented PII protection (masking, tokenisation or access tiering) across environments.
- Platform engineering experience: diagnosing infrastructure issues, not just consuming platform services.
- Track record of autonomous delivery, including direct stakeholder engagement.
- Databricks Certified Data Engineer Associate (minimum).
- Desirable
- Databricks Certified Data Engineer Professional.
- Microsoft AZ-400: Designing and Implementing Microsoft DevOps Solutions.
- Multi-environment Azure networking (VNet peering, DNS zone design, NAT Gateway).
- Migrating or standing up CI/CD pipelines, incl. introducing pipeline templates/standards.
- Governance and identity patterns (e.g. Entra ID, RBAC scoping).
- Applying regulatory frameworks (e.g. GDPR) to data platform design.
- Shared service centre or global delivery model experience, ideally in energy or industrial services.
Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Systems or a related discipline, or equivalent practical experience.
About EnerMech
Specialist provider of integrated energy and industrial solutions.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at EnerMech
Workshop Supervisor
Abu Dhabi, UAE
EnerMech is seeking a Workshop Supervisor to oversee heavy-equipment component refurbishment, repair, and maintenance, while leading technicians and ensuring safe, quality workshop operations. Candidates need at least 5
Lifting Appointed Person
Abu Dhabi, UAE
EnerMech is seeking an experienced Lifting Appointed Person to plan, coordinate, and supervise platform lifting operations, including complex crane lifts. Candidates need at least 10 years of relevant lifting experience,
Global QHSE Lead Auditor
Houston, USA
EnerMech provides integrated solutions for complex energy projects worldwide, combining best-in-class equipment and cutting-edge technology that supports the entire asset life-cycle, along with decades of unrivaled exper
Facilities Coordinator
Aberdeen, GBR
We Are? We are EnerMech, a specialist service company that delivers safe, integrated solutions for complex energy projects. For over 50 years, we've been energizing our clients across the world with unrivalled expertise,
Global Head of QHSE Systems and Assurance
Houston, USA
We are EnerMech, a specialist service company that delivers safe, integrated solutions for complex energy projects. For over 50 years, we have supported our clients across the world with unrivalled expertise, equipment,
Crane Operator/Mechanic 2/3
Aberdeen, GBR
We Are? We are EnerMech, a specialist service company that delivers safe, integrated solutions for complex energy projects. For over 50 years, we've been energizing our clients across the world with unrivalled expertise,
Tax Manager - Americas
, GBR
Workshop Supervisor
Abu Dhabi, UAE
Lifting Appointed Person
Abu Dhabi, UAE
Global QHSE Lead Auditor
Houston, USA
Facilities Coordinator
Aberdeen, GBR
Global Head of QHSE Systems and Assurance
Houston, USA
Crane Operator/Mechanic 2/3
Aberdeen, GBR