{bc}

Data Engineer

ConfidentialAbu Dhabi Emirate, UAE1 months agoMid-Seniorfulltime
Machine LearningPythonScalaSQLVAT
Generate Resume for this Job
Via LinkedIn·

About This Role

Job Summary

We are seeking a Senior / Lead Data Engineer to design, build, and scale AI-powered, cloud-native data platforms that support enterprise analytics, machine learning, and business-critical decision-making.

The ideal candidate will bring deep expertise in data engineering, cloud data warehouses, cost optimization, and AI-assisted development , with a proven track record of delivering high-impact, revenue-generating data platforms and intelligent automation solutions at scale.

Key Responsibilities

Data Platform & Pipeline Engineering

  • Design, develop, and maintain scalable ETL/ELT pipelines using Python, SQL, dbt, and modern orchestration tools.
  • Build and optimize cloud-based data warehouses (BigQuery or equivalent) supporting high-volume analytical workloads.
  • Implement robust data modeling (dimensional and analytical models) to enable self-service analytics and AI use cases.
  • Ensure data quality, integrity, and freshness through automated validation frameworks and monitoring.

AI-Driven Automation & Innovation

  • Design and deploy AI-powered internal tools and agents to automate data engineering workflows, incident diagnosis, and root cause analysis.
  • Integrate AI agents with collaboration tools (e.g., Slack) to improve operational efficiency and reduce incident resolution time.
  • Apply AI-assisted development techniques to accelerate delivery, improve code quality, and reduce manual effort across teams.

Performance & Cost Optimization

  • Lead cloud cost optimization initiatives , including query optimization, architectural redesign, and usage monitoring.
  • Drive measurable reductions in data platform operational costs while maintaining performance and reliability.

Cloud & DevOps

  • Build and deploy data services using containerized and CI/CD-driven workflows .
  • Collaborate with DevOps and platform teams to ensure scalable, secure, and reliable cloud infrastructure.
  • Support multi-cloud or hybrid environments as required (GCP, Azure).

Leadership & Collaboration

  • Provide technical leadership and mentorship to data engineers.
  • Establish SOPs, best practices, and engineering standards across the data function.
  • Partner closely with product, analytics, and business stakeholders to translate requirements into scalable data solutions.

Required Skills & Qualifications

Technical Skills

  • Programming: Python (expert), SQL (expert), Shell scripting (advanced).
  • Data Engineering: dbt, ETL/ELT pipelines, data warehousing, data modeling, data quality frameworks.
  • Cloud Platforms: Google Cloud Platform (BigQuery, Cloud Run) – strong experience; Azure familiarity is a plus.
  • Orchestration & Automation: Airflow or equivalent.
  • DevOps & Tooling: Git, Docker, CI/CD pipelines.
  • AI & ML Exposure: AI agent frameworks, ML pipelines, model lifecycle management, observability tools.

Data Management

  • Cost optimization and performance tuning.
  • Data governance, cataloging, and best-practice documentation.

Education

  • Bachelor’s degree in Computer Science or related field.
  • Master’s or Postgraduate qualification in Data Science is preferred.

Nice to Have

  • Experience delivering AI/ML pipelines in production environments.
  • Exposure to government, public sector, or regulated enterprise data platforms .
  • Experience building observability and monitoring tools for data platforms.
  • Prior work on Arabic-language or regional datasets .

Similar Jobs

Data Engineer

DUBAI PROPERTIES GROUP LLC · Dubai

Senior

Design and maintain data pipelines, implement ETL standards, collaborate with stakeholders, and ensure data quality using Python and SQL.

Data EngineerData EngineeringData Systems Engineer

SQL and Power BI Data Engineer

Dicetek LLC · Dubai

Senior

Seeking a skilled data engineer with expertise in Power BI, SQL, ERP systems, and data modeling for report development and analytics.

Report DevelopmentPower BIBI Developer

Lead Data Engineer

Capgemini · Abu Dhabi

**About the job you are considering** ------------------------------------- Capgemini Global Insights \& Data business line is a market leader in the data, platform, and analytics across all regions and across many secto

AWSAzureGCP

Lead Data Engineer

Capgemini · Abu Dhabi

**About the job you are considering** ------------------------------------- Capgemini Global Insights \& Data business line is a market leader in the data, platform, and analytics across all regions and across many secto

AWSAzureGCP

SQL and Power BI Data Engineer

Dicetek LLC · Dubai

Mid-Senior

The Business Analyst — Power BI, Power Automate \& Data is a pivotal programme resource for Project, responsible for bridging the gap between raw legacy data and actionable business intelligence during. This role combine

SQLExcelPower BI

Consultant, Data Engineering within the Community Trust Index

International Federation of Red Cross and Red Crescent Societies - IFRC · Global Village

Mid-Senior

Organizational Context The International Federation of Red Cross and Red Crescent Societies (IFRC) is the world's largest humanitarian network, uniting 191\-member National Societies under a shared mission to prevent and

SQL and Power BI Data Engineer

DICETEK LLC · Dubai

The Business Analyst — Power BI, Power Automate \& Data is a pivotal programme resource for Project, responsible for bridging the gap between raw legacy data and actionable business intelligence during. This role combine

SQLExcelPower BI

Data Engineer

Searchability® · Abu Dhabi Emirate

Mid-Senior

**DATA ENGINEER – AI \& INVESTMENT PLATFORM – ABU DHABI (HYBRID)** **KEY POINTS** * AI\-focused Data Engineering role within a growing investment technology environment * 2 days per week onsite in Abu Dhabi * Salary up t

Scala

SQL & Power BI Data Engineer

Brad Contech Solutions · Dubai

Mid-Senior

**Location:** Dubai (Onsite) **Experience:** 4\+ Yrs **Notice:** Immediate Joiners Preferred **Technical Skills \& Qualifications** -------------------------------------- * Minimum 4 years’ experience as a Business Analy

SQLExcelPower BI
AI Job Platform

Stop applying blindly. Start getting hired.

Base Career automates the hardest parts of job searching — apply smarter, not harder.

AI Resume in 60s

Your resume rewritten for this exact role using the job description as the brief.

ATS-Optimized

Get past automated screening filters with the right keywords matched to each job.

Application Tracker

Track every job, follow-up, and interview in one visual kanban board.

Start Today for Free

Free plan · No credit card required