Databricks Data Quality & Remediation Architect Lead

Role overview

Location and workplace

• Hybrid role in the UAE; Abu Dhabi is preferred.

Contract and rate

• Six-month contract initially, with a strong likelihood of extension.
• Rate is competitive and depends on experience.

What you will do

• Design and implement a scalable Data Quality & Remediation Engine on Databricks.
• Define architecture for profiling, quality rules, exception management, root-cause analysis, and remediation.
• Build a metadata-driven data-quality framework and define Bronze, Silver, and Gold processing layers.
• Work with Data Governance teams and Data Stewards on Critical Data Elements and data-quality processes.
• Support Microsoft Purview integration, governance, lineage, and auditability.
• Lead the development team and provide hands-on technical direction.
• Own quality reporting, including KPIs, exceptions, and remediation activity.

Required qualifications and experience

• 5+ years of experience in data engineering, Databricks, or related roles.
• Strong hands-on Databricks experience; excellent Python and PySpark skills.
• Strong knowledge of Databricks Lakehouse, Delta Lake, Unity Catalog, Workflows, Lakeflow, and Databricks SQL.
• Experience with Azure Databricks, Data Factory, ADLS Gen2, and Azure DevOps.
• Experience with data quality, governance, or remediation solutions.
• Strong technical leadership and stakeholder-management skills.
• Ideally, 2+ years in a lead or architect position.

Desirable experience

• Microsoft Purview.
• SAP S/4HANA, SAP BW, or Oracle Fusion.
• MLflow, Mosaic AI, or Databricks Asset Bundles.
• Enterprise data governance and lineage.