Lead Data Engineer

Overview

What You Will Do

• **Technical leadership:**
• set standards for code quality and system design, own architecture decisions across our data lakes and warehouses, and mentor engineers
• **Pipelines and processing:**
• design and optimise batch and real-time pipelines using Python, Go, Airflow, and DBT; lead schema migrations across disparate systems, including cleansing and normalisation
• **Infrastructure and cloud:**
• provision and manage AWS (S3, Redshift, RDS) with Terraform and Ansible; run containerised workloads with Docker and Kubernetes (EKS)
• **Reliability:**
• keep Kafka, Redshift, and Kubernetes optimised and available, with monitoring and alerting through Sumo Logic and PagerDuty
• **Data and storage:**
• select the right database for the job across SQL, NoSQL, and graph, with depth in MySQL and PostgreSQL, and optimise queries and data structures for performance
• What you bring
• 3 to 5+ years in data engineering, with a strong grounding in distributed systems and modern data architecture
• Strong production-level Python and/or Go
• Hands-on experience with Apache Kafka, AWS Redshift, Apache Airflow, and DBT, across both ETL and ELT
• AWS expertise, solid SQL and NoSQL (MySQL, PostgreSQL preferred), and familiarity with Parquet, Avro, Iceberg, and Hudi
• Understanding of data security and regulatory frameworks such as GDPR
• *Nice to have: Scala, and experience in a regulated financial services or fintech environment.*
• Why this role
• You will shape how a multi-jurisdiction fintech handles trading data at the source, with direct ownership of architecture decisions from day one.
• To apply
• Apply through LinkedIn or reach out to our talent team directly.
• *#DataEngineering #FinTechJobs #Python #Golang #AWS #Kafka #DubaiJobs #CyprusJobs*