Data Engineer
Role Overview
Designs and optimizes ingestion, transformation, and serving layers across Azure Databricks, Delta Lake, and Databricks SQL.
Supports the new Renewables Data Platform and migration of existing data solutions from Synapse.
The role is hands-on and collaborative within the Data & AI team.
Key Skills for This Role
Full Job Posting
Role overview
Designs and optimizes ingestion, transformation, and serving layers across Azure Databricks, Delta Lake, and Databricks SQL.
Supports the new Renewables Data Platform and migration of existing data solutions from Synapse.
The role is hands-on and collaborative within the Data & AI team.
Location and working pattern
- Expected to spend 50% of the working week in Reading, Perth, or Glasgow.
- Permanent, full-time position with Flexible First options.
Salary
- Salary range is £36,200–£54,400, plus a performance-related bonus and benefits.
Data pipelines and modeling
- Build and maintain metadata-driven pipelines for batch and streaming ingestion and transformation.
- Develop Delta Lake bronze, silver, and gold layers and model data for BI and analytics.
- Use Databricks pipelines, jobs, notebooks, PySpark, and SQL for large-scale transformations.
- Integrate Power BI through Databricks SQL and optimize models for performance and usability.
Quality, governance, and delivery
- Implement data quality, monitoring, and performance practices.
- Support governance, security, and compliance using Unity Catalog lineage, cataloguing, and code-managed permissions.
- Apply data protection controls and contribute to SLAs, SLOs, and data contracts.
- Collaborate across data, DevOps, and product teams to refine requirements and deliver version-controlled solutions through CI/CD.
Candidate profile
- Experience delivering data solutions in a growing business with varied data needs and managing workload priorities.
- Strong communication with technical and non-technical stakeholders.
- Adaptable, proactive, and willing to learn and develop.
- Proven experience building metadata-driven batch and streaming pipelines in Azure Databricks and developing Delta Lake bronze, silver, and gold architectures.
- Technical capability in large-scale processing using Python, PySpark, and SQL, including data quality.
- Experience designing performant BI and analytics models with Power BI integration.
About SSE
SSE is an energy company focused on a net-zero future and is developing offshore wind and investing in low-carbon electricity.
Its IT division supports business growth with systems, software, security, data, analytics, and emerging technologies.
Benefits
- Benefits include private healthcare and gym discounts, online GP access, counselling, interest-free loans for technology and transport season tickets, a Cycle to Work scheme, and family leave entitlements.
Application checks
- The employer states that a criminality check and credit check are required before starting if an offer is made.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at SSE PLC
Senior Product Analyst - Operational Technology
Reading, GBR
SSE is seeking a Senior Product Analyst to support its Operational Technology Security and Private Networks value streams. You will lead requirements and product analysis, support Agile delivery, and help move work from
GIS Analyst
Aberdeen, GBR
SSEN Transmission is looking for a GIS Analyst to support major capital projects by managing spatial data and developing GIS solutions for infrastructure planning. The role includes cartographic support, applications, wo
R2R Accountant
Glasgow, GBR
SSE is seeking an accountant to support its centralised Record to Report Centre of Excellence. You will deliver financial reporting and controls across accounting activities; a professional accounting qualification and r
Regulation Senior Analyst
Aberdeen, GBR
SSE is seeking a Senior Analyst to develop evidence-led regulatory analysis and policy positions for its electricity transmission business. The role covers consultations, industry working groups, regulatory projects and
Senior Investment Manager
London, GBR
SSE Thermal seeks a Senior Investment Manager to lead investment analysis and business-case development for major energy and infrastructure projects, while developing a team of analysts. Candidates need significant DCF m
Senior Business Analyst
Reading, GBR
SSE is seeking a Senior Business Analyst to support a major transformation programme focused on agility, digital capability, and customer journeys. You will lead requirements gathering, design future processes, support s
Environmental Performance Analyst
Inverness, GBR
SSE is seeking an Environmental Performance Analyst to improve how its transmission business measures and reports environmental performance. You’ll build dashboards, metrics and visualisations, analyse trends, and provid
Risk & Controls Manager (Cyber & Technology)
Glasgow, GBR
SSE is seeking a manager to strengthen cyber and technology risk and controls across its businesses. The role calls for practical risk-and-control experience in a complex organisation, strong analysis and communication,
Senior Product Analyst - Operational Technology
Reading, GBR
GIS Analyst
Aberdeen, GBR
R2R Accountant
Glasgow, GBR
Regulation Senior Analyst
Aberdeen, GBR
Senior Investment Manager
London, GBR
Senior Business Analyst
Reading, GBR
Environmental Performance Analyst
Inverness, GBR
Risk & Controls Manager (Cyber & Technology)
Glasgow, GBR