Data Test /Quality Engineer – Pyspark / Databricks / DataFactory
About This Role
Data Test /Quality Engineer – Pyspark / Databricks / DataFactory
Experience: 5+ Years
Location : Abu Dhabi , UAE (onsite)
Job Summary
We are hiring a Data Quality Engineer to ensure high-quality, accurate, and reliable data across enterprise ETL pipelines and reporting systems. The candidate will play a key role in maintaining data integrity across the lakehouse architecture.
Key Responsibilities
Validate ETL pipelines using Databricks, Delta Lake, and Azure Data Factory (ADF)
Perform data profiling, cleansing, and validation across source-to-target systems
Detect and resolve data issues such as duplicates, nulls, mismatches, and inconsistencies
Validate incremental load processes and data refresh logic
Ensure data consistency across Bronze → Silver → Gold layers
Implement automated data quality checks and monitoring frameworks
Perform data reconciliation and root cause analysis for data issues
Collaborate with data engineers, BI teams, and stakeholders to resolve defects
Required Skills
Strong SQL skills
Hands-on experience with Databricks and Delta Lake
Experience with Azure Data Factory (ADF)
Knowledge of incremental load validation
Data profiling and data quality techniques
Understanding of data governance principles
Good to Have
Experience with automation using Python / PySpark
Familiarity with monitoring tools and data quality frameworks
Knowledge of lakehouse architecture
Job Types: Full-time, Contract
Pay: AED7,000.00 - AED10,000.00 per month
Application Question(s):
- Current Monthly Salary ?
- Expected Monthly Salary ?
- In how many days you can join us if shortlisted?
- How many years of experience do you have in SQL coding or Testing ?
- Please rate your English communication skills out of 10 (1 is lowest and 10 is highest)?
- Have you gone through the JD and ok to perform all the responsibilties mentioned?
- Please write down your technical skills which makes you a fit for this role from the JD ?
- What is your Visa Status ?
- How many years of experience do you have in Data Quality role ?
- How many years of experience do you have in testing ETL pipelines using Databricks, Delta Lake, and Azure Data Factory (ADF)?
Work Location: In person
Similar Jobs
Data Test Engineer – Databricks Delta Lake
GlobalXperts Technology · Abu Dhabi
**Data Test Engineer – Databricks Delta Lake** **Experience: 3–6 Years** **Location : Abu Dhabi , UAE (onsite)** **Job Summary** We are looking for a skilled Test Engineer with strong experience in data validation, ETL t
1 months ago
Generate Resume ↗Data Test Engineer – Databricks Delta Lake
GlobalXperts Technology · Abu Dhabi
**Data Test Engineer – Databricks Delta Lake** **Experience: 3–6 Years** **Location : Abu Dhabi , UAE (onsite)** **Job Summary** We are looking for a skilled Test Engineer with strong experience in data validation, ETL t
1 months ago
Generate Resume ↗Stop applying blindly.
Start getting hired.
Base Career automates the hardest parts of job searching — apply smarter, not harder.
AI Resume in 60s
Your resume rewritten for this exact role using the job description as the brief.
ATS-Optimized
Get past automated screening filters with the right keywords matched to each job.
Application Tracker
Track every job, follow-up, and interview in one visual kanban board.
Free plan · No credit card required