{bc}
pinpoint

Lead Data Engineer

Made Tech
Bristol, GBR
Full-time
Senior
Hybrid
GBP 80000-96000 yearly / year
Discovered 4 weeks ago
PythonAWSAzureGCPApache SparkTerraform

Full Job Posting

Key Responsibilities

  • Define, shape, and implement cloud-native data strategies, and security-first engineering.
  • Empower public sector teams to unlock the strategic value of their data by designing scalable, high-impact data solutions..
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.
  • As employee growth is a huge focus here at Made Tech, we would expect you to contribute to our recruitment efforts and encourage you to take on line management responsibilities.
  • In some cases, you will work within the larger MadeTech team to identify growth opportunities within the account.
  • Contribute to our practice by sharing knowledge, coordinating presentations and representing the capability internally and externally

Skills, Knowledge & Expertise

  • Proficiency in Python
  • Proficiency in cloud platforms like AWS, Azure, or GCP
  • The capacity to build and manage large-scale data transformation workflows
  • Proficiency in managing PII and sensitive information while ensuring compliance with data legislation.
  • Champion a Test-Driven Development (TDD) approach and share experience in implementing testing strategies including unit, integration, and data quality assessments
  • An understanding of fundamental software principles, particularly SOLID and DRY
  • Experience with version control systems such as GitHub or Bitbucket
  • Knowledge of contemporary data architectures, including Data Lakes, Data Warehouses, and Data Lakehouses
  • The ability to organize and transform diverse data types into standardized, unified schemas
  • Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems.
  • Analytics & Platform Frameworks like Apache Spark or similar cloud-specific services.
  • Transformation & Orchestration tools
  • Database Technologies
  • Libraries & Schema Management
  • Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet
  • Containerisation
  • Experience of deploying Data platforms and pipelines
  • Strong experience in IaC, preferably Terraform
  • Experience in establishing CI/CD pipelines to ensure code excellence and support rapid, iterative releases
  • Experience of implementing logging, monitoring and checks for vulnerabilities
  • The ability to accurately talk about cost estimates when designing, deploying, and managing services
  • Experience and aptitude for interpreting the business and data landscape to guide Delivery and Product managers, ensuring project success by recognising client requirements, alongside other disciplines (e.g., Business Analysts, User Researchers).
  • Skilled at discussing DataOps utilities across orchestration, analytics, and data integration.
  • Proven track record in agile delivery environments, with the ability to work in teams that function in Kanban, XP, or Scrum frameworks.
  • Ability to foster organic account growth through a commercial mindset and engagement with senior stakeholders.
  • Ability and desire to work in cross functional teams
  • A desire to upskill and share knowledge with a team and within the organisation
  • Mentoring, managing and developing talent within the organisation
  • Collaborating within multidisciplinary digital and technology teams encouraging practices like Pair programming
  • Experience with specialised Data Platforms focused on specific domains like Financial or Geospatial data
  • Operating within the public sector, including the facilitation of data sharing and utilisation across various government departments
  • Partnering with data scientists to transition advanced data deliverables, such as machine learning models, into production environments

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Made Tech