pinpoint
Lead Data Engineer
Made Tech
Bristol, GBR
Full-time
Senior
Hybrid
GBP 80000-96000 yearly / year
Discovered 4 weeks ago
PythonAWSAzureGCPApache SparkTerraform
Key Skills for This Role
PythonAWSAzureGCPApache SparkTerraform
Full Job Posting
Key Responsibilities
- Define, shape, and implement cloud-native data strategies, and security-first engineering.
- Empower public sector teams to unlock the strategic value of their data by designing scalable, high-impact data solutions..
- Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.
- As employee growth is a huge focus here at Made Tech, we would expect you to contribute to our recruitment efforts and encourage you to take on line management responsibilities.
- In some cases, you will work within the larger MadeTech team to identify growth opportunities within the account.
- Contribute to our practice by sharing knowledge, coordinating presentations and representing the capability internally and externally
Skills, Knowledge & Expertise
- Proficiency in Python
- Proficiency in cloud platforms like AWS, Azure, or GCP
- The capacity to build and manage large-scale data transformation workflows
- Proficiency in managing PII and sensitive information while ensuring compliance with data legislation.
- Champion a Test-Driven Development (TDD) approach and share experience in implementing testing strategies including unit, integration, and data quality assessments
- An understanding of fundamental software principles, particularly SOLID and DRY
- Experience with version control systems such as GitHub or Bitbucket
- Knowledge of contemporary data architectures, including Data Lakes, Data Warehouses, and Data Lakehouses
- The ability to organize and transform diverse data types into standardized, unified schemas
- Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems.
- Analytics & Platform Frameworks like Apache Spark or similar cloud-specific services.
- Transformation & Orchestration tools
- Database Technologies
- Libraries & Schema Management
- Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet
- Containerisation
- Experience of deploying Data platforms and pipelines
- Strong experience in IaC, preferably Terraform
- Experience in establishing CI/CD pipelines to ensure code excellence and support rapid, iterative releases
- Experience of implementing logging, monitoring and checks for vulnerabilities
- The ability to accurately talk about cost estimates when designing, deploying, and managing services
- Experience and aptitude for interpreting the business and data landscape to guide Delivery and Product managers, ensuring project success by recognising client requirements, alongside other disciplines (e.g., Business Analysts, User Researchers).
- Skilled at discussing DataOps utilities across orchestration, analytics, and data integration.
- Proven track record in agile delivery environments, with the ability to work in teams that function in Kanban, XP, or Scrum frameworks.
- Ability to foster organic account growth through a commercial mindset and engagement with senior stakeholders.
- Ability and desire to work in cross functional teams
- A desire to upskill and share knowledge with a team and within the organisation
- Mentoring, managing and developing talent within the organisation
- Collaborating within multidisciplinary digital and technology teams encouraging practices like Pair programming
- Experience with specialised Data Platforms focused on specific domains like Financial or Geospatial data
- Operating within the public sector, including the facilitation of data sharing and utilisation across various government departments
- Partnering with data scientists to transition advanced data deliverables, such as machine learning models, into production environments
About Made Tech
IT Services & Consulting374 employeesFounded 2008
UK public-sector digital, data and technology services provider serving government, healthcare, and public infrastructure organisations.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Made Tech
Senior Strategy and Change Practitioner
Bristol, GBR
Discovered 2 weeks agoFull-time
Senior Data Scientist - SC cleared
Bristol, GBR
Discovered 2 weeks agoFull-time
Senior Business Analyst
Bristol, GBR
Discovered 3 weeks agoFull-time
Data Engineer
Bristol, GBR
Discovered 3 weeks agoFull-time
Industry Delivery Director
Bristol, GBR
Discovered 3 weeks agoFull-time
Lead Software Engineer
Bristol, GBR
Discovered 4 weeks agoFull-time
Senior Data Analyst
Bristol, GBR
Discovered 1 months agoFull-time
Senior Data Engineer
Bristol, GBR
Discovered 1 months agoFull-time