{bc}
linkedin

Senior Data Engineer

Xebia
Abu Dhabi, UAE
fulltime
Mid-Senior
Today
Big DataETLData WarehousingCloud Computing (AWSAzureGCP)
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

Big DataETLData Warehousing
Smart Apply

Full Job Posting

About The Role

We're seeking a proactive, hands-on Senior Data Engineer to drive our Databricks-centric Lakehouse — Delta tables governed by Unity Catalog, Lakeflow pipelines, and AI/BI layers like Genie and dashboards.

The ideal candidate will work autonomously, take full ownership of pipelines end-to-end, and keep pace with the fast-evolving Databricks ecosystem.

Experience

: 7–10 year

sType

: Independent Contributor (able to operate with minimal supervision

)Location

: Abu Dhab

i

Key Responsibiliti

1. **esPipeline Orchestratio**

n: Design and build robust data ingestion and orchestration pipelines, with Databricks (Lakeflow Jobs/Workflows) as the primary platform and Azure Data Factory supporting legacy/external needs — taking full ownership of pipeline reliability and the transition toward Databricks-native orchestratio

2. **n.Lakehouse Data Engineerin

g: Build and maintain scalable Delta Lake tables under Unity Catalog — schema design, access controls, lineage tracking, and data quality across bronze/silver/gold layer

3. **s.Lakeflow Pipeline Developmen

t: Build declarative ETL pipelines using Databricks Lakeflow, incorporating CDC, incremental processing, and data quality validation

4. **s.AI And BI & Genie Enablemen

t: Design and maintain semantic layers, metrics, and certified datasets to support Genie spaces and AI/BI dashboards, enabling natural-language querying and self-service analytic

5. **s.SharePoint And External Source Integratio

n: Configure and maintain Lakeflow Connect (or similar) integrations for ingesting SharePoint and other external data sources into the Lakehouse with minimal manual effor

6. **t.Governance & Best Practice

s: Apply Unity Catalog governance controls — access policies, data masking, audit logging — and uphold strong engineering practices (CI/CD, version control, testing

).

Must-Have Ski

  • llsStrong hands-on Databricks expertise — PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Cata
  • logWorking knowledge of Azure Data Fact
  • oryExperience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validati
  • onsExposure to Databricks AI/BI or Genie (semantic layers, certified datase
  • ts)Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundl
  • es)Demonstrated ability to own deliverables fully and resolve issues independen
  • tlyStrong communication skills for working with business/analytics stakehold
  • ers
  • We are an Equal Opportunity Employer committed to fostering a diverse, inclusive, and respectful workplace.
  • All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.
  • We believe diversity drives innovation and success, and we welcome individuals from all backgrounds to join our t
  • eam.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Xebia