Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Location: On-site in Abu Dhabi We’re looking for an experienced, hands-on Data Engineer capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back Office of one of our clients.
Key Skills for This Role
Full Job Posting
On-Site In Abu Dhabi
We’re looking for an experienced, hands-on
Data Engineer
capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back Office of one of our clients.
The ideal candidate has familiarity with financial markets (securities, prices, corporate actions, positions/holdings) and thrives in ambiguous environments - proactively shaping solutions rather than waiting for tickets.
You will own data end-to-end: from ingesting vendor and internal sources, to modeling in the lakehouse, to ensuring data is discoverable, reliable, and cost-efficient.
You will collaborate closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.
Responsibilities
- Participate in requirements clarification and sprint planning sessions
- Design technical solutions and implement them
- Build robust ETL pipelines using
Pyspark
- for extraction and transformation
- Optimize and tune existing ETL processes for performance, scalability, and reliability
- Write unit and integration tests
- Support QA teammates during acceptance testing
- Resolve production incidents as a 3rd line engineer
Required Skills
- Minimum 5 years of experience in IT/Data
- Proficiency in PySpark for distributed computing
- Strong Python skills for ETL development
- Strong expertise in writing and optimizing complex SQL queries
- Experience with PostgreSQL, MySQL, Oracle, or Snowflake preferred
- Experience with data warehousing concepts and platforms (ideally Databricks)
- Familiarity with ETL tools and processes
- Experience with Data Modeling
- Proficiency with Git
- Experience with Prometheus, Grafana, or custom monitoring scripts
- Experience implementing data validation, cleansing, and quality frameworks (ideally Monte Carlo)
- Familiarity with Azure DevOps, Jira, and/or Confluence
- Strong debugging and troubleshooting skills for complex data issues
- Strong written and verbal communication skills
- Ability to explain technical concepts to non-technical stakeholders
- Understanding of the
- Investment Data domain
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Toptal
Data Specialist
Abu Dhabi, UAE
Provide L2 production support for enterprise Lakehouse data platforms, resolving incidents, performing diagnostics, and coordinating with engineering teams. Requires strong DataOps experience and hands-on Lakehouse platf
Data Specialist
Abu Dhabi Emirate, UAE
Toptal is an elite network of the world's top talent, connecting the best and brightest in business, design, and technology with leading organizations worldwide. We deliver freelance opportunities on an independent contr
Python Solutions Engineer DUBAI
Dubai, UAE
Job Description Summary This applied research facility transforms theoretical AI into practical tools for aviation, healthcare, and logistics, with a core focus on advanced robotics. By prototyping everything from autono
Quality Assurance Engineer
Abu Dhabi, UAE
Join Toptal’s Elite Network of Freelance Talent Toptal is an exclusive network of the world’s top freelance software developers, designers, finance experts, product managers, and project managers. As one of the fastest-g
Databricks Platform Engineer
Abu Dhabi Emirate, UAE
Location: On-site in Abu Dhabi Seeking a highly skilled and motivated Data Platform Engineer to join our client's core platform team. This role focuses on building advanced platform capabilities, optimizing and maintaini