{bc}
indeed

Data Engineer

COGNITA SCHOOLS
London, GBR
Onsite
Discovered 2 weeks ago
Azure DatabricksPySparkDelta LakeDatabricks JobsSQLMedallion architecture

Full Job Posting

About the role

Build and maintain Cognita’s modern data platform and scalable pipelines in Azure Databricks.

Transform data from HubSpot CRM, MIS, Finance and HR platforms into reliable, high-quality datasets for business use.

Work with analysts, analytics engineers, platform engineers and the wider Group Data team.

Responsibilities

  • Manage data across the bronze and silver layers of the medallion architecture.
  • Build ingestion processes for structured and semi-structured data.
  • Maintain resilient, observable and well-governed pipelines with data quality controls, monitoring and schema management.
  • Deliver data models for organisational needs and maintain standards through documentation, code reviews and CI/CD.
  • Translate business requirements into scalable and maintainable data solutions.

Who we are looking for

  • Proven experience designing and delivering production-grade cloud data pipelines.
  • Strong Azure Databricks expertise, including PySpark, Delta Lake and Databricks Jobs; excellent SQL and medallion architecture knowledge.
  • Experience with CRM, MIS, Finance and HR data, API-based ingestion, and JSON, CSV and Parquet.
  • Ability to implement data quality controls, manage schema changes and use Git-based version control.
  • Collaborative problem-solving and communication skills for working with technical and non-technical stakeholders.
  • A relevant degree, Azure certifications and ongoing cloud-data professional development are advantageous.

Working arrangement

  • Four days per week in the London office and one day working from home.

Benefits

  • Competitive salary based on experience, private medical insurance and healthcare cash plan.
  • GPP pension, life assurance and 25 days of annual leave plus bank holidays.
  • Employee assistance programme, employee discounts and professional subscriptions.

Safeguarding

  • Appointments are subject to safer recruitment checks, including an enhanced DBS check.
  • The closing date for applications is Sunday 18 October 2026.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at COGNITA SCHOOLS