Senior Data Engineer
About This Role
We are seeking a highly skilled Senior Data Engineer to join our Data Engineering team. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and enabling advanced analytics and machine learning use cases. This role requires strong expertise in big data technologies, data processing frameworks, and feature engineering to support ML models in a production environment.
Key Responsibilities
- Gather and analyze business and technical requirements for data solutions
- Perform Exploratory Data Analysis (EDA) to understand data patterns and quality
- Design, build, and maintain scalable and high-performance data pipelines
- Ingest structured and unstructured data from multiple sources
- Transform and process large datasets using PySpark and Python
- Implement feature engineering techniques for machine learning models
- Optimize Spark jobs for performance and cost efficiency
- Ensure data quality, integrity, and security across pipelines
- Collaborate with Data Scientists, Analytics Teams, and Delivery Leads
- Work in an Agile environment with cross-functional teams
- Communicate effectively with stakeholders and provide technical insights
- Maintain version control and CI/CD workflows using Git
Required Skills & Expertise
- Strong experience in Python and PySpark
- Hands-on expertise in Apache Spark (performance tuning & optimization)
- Solid knowledge of Hadoop ecosystem
- Advanced proficiency in SQL
- Experience in building end-to-end data pipelines and ML pipelines
- Strong understanding of data modeling and data warehousing concepts
- Experience with feature engineering for ML use cases
- Familiarity with Git and version control systems
- Exposure to cloud platforms (AWS/Azure/GCP) is a plus
Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- 8-10+ years of experience in Data Engineering / Big Data
- Prior experience working in banking or financial services is preferred
Soft Skills
- Strong problem-solving and analytical thinking
- Excellent communication and stakeholder management skills
- Ability to work independently and in a team environment
- Adaptability to fast-paced Agile workflows
Similar Jobs
Senior Data Scientist
Dataiku · Dubai
Dataiku is the Platform for AI Success, the enterprise orchestration layer for building, deploying, and governing AI. In a single environment, teams design and operate analytics, machine learning, and AI agents with the
2 days ago
Generate Resume ↗Senior Data Analyst, Partner Development - (Statistics/ML/BI) (Bangkok-based, relocation provided)
Agoda · Dubai
**About Agoda** At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to exp
2 days ago
Generate Resume ↗Data Analyst/ Senior Data Analyst (Statistics/Python/BI) (Bangkok-based, relocation provided)
Agoda · Abu Dhabi
**About Agoda** At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to exp
2 days ago
Generate Resume ↗Senior Data Engineer
Emaratech · Dubai
Manage and optimize data lake platforms, implement cloud-native solutions, and ensure data governance while utilizing tools like Apache NiFi and Spark.
3 days ago
Generate Resume ↗Senior Data Analytics Manager UAEN
Confidential · Abu Dhabi Emirate
A leading organization is seeking a **Senior Manager – Data Analytics** to lead and transform its enterprise data and analytics capabilities. This is a strategic leadership role focused on driving a **data\-driven cultur
3 days ago
Generate Resume ↗Senior Data Analyst, Partner Development - (Statistics/ML/BI) (Bangkok-based, relocation provided)
Agoda · Sharjah
**About Agoda** At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to exp
4 days ago
Generate Resume ↗Senior Data Engineer
emaratech · Dubai
**About The Role** We are seeking a highly skilled and experienced Data Lake Cloud Engineer with a proven track record of designing, implementing, and maintaining large\-scale cloud\-based data lake platforms. This role
4 days ago
Generate Resume ↗Senior Data Architect (AWS Data Platforms)
NorthBay - Pakistan · Dubai
**Job Title:** Senior Data Architect – AWS **Location:** Dubai, UAE (Onsite) **Experience Required:** 12\+ Years **Employment Type:** Full\-Time **Work Mode:** Onsite **Job Summary** We are seeking a highly experienced S
4 days ago
Generate Resume ↗Senior Data Engineer
emaratech · Dubai
About the Role We are seeking a highly skilled and experienced Data Lake Cloud Engineer with a proven track record of designing, implementing, and maintaining large\-scale cloud\-based data lake platforms. This role requ
4 days ago
Generate Resume ↗Stop applying blindly.
Start getting hired.
Base Career automates the hardest parts of job searching — apply smarter, not harder.
AI Resume in 60s
Your resume rewritten for this exact role using the job description as the brief.
ATS-Optimized
Get past automated screening filters with the right keywords matched to each job.
Application Tracker
Track every job, follow-up, and interview in one visual kanban board.
Free plan · No credit card required