Data Platform Engineer

Role overview

Platform management

• Manage S3 bucket configurations, lifecycle policies, and storage optimization.
• Manage AWS Glue jobs and optimize jobs and DPU allocation.
• Maintain the AWS Glue Data Catalog and Iceberg table registry.
• Deploy and integrate the semantic layer; deploy, configure, and upgrade OpenMetadata.
• Maintain Soda Core infrastructure and integration.
• Apply Iceberg best practices and implement automated table maintenance.

Automation and self-service

• Deploy self-service tooling for Data Factory squads.
• Automate lineage capture from Glue jobs.
• Configure audit logging using CloudTrail and S3 access logs.

Reliability and roadmap

• Design and implement disaster recovery scenarios covering failover, backups, and runbooks.
• Conduct annual disaster recovery tests for the data landscape.
• Monitor critical platform components, set up alerting, and actively follow up.
• Execute the decommissioning roadmap.

Collaboration

• Coordinate with platform engineers and architects on optimization and tooling.
• Partner with operational teams on monitoring and alerting.

Required technical experience

• Strong experience managing AWS Lakehouse platforms.
• Proficiency with S3, Glue, CloudTrail, and Athena.
• Hands-on experience with Apache Iceberg, OpenMetadata, and Soda Core.
• Knowledge of disaster recovery planning and execution.
• Infrastructure automation experience using Terraform and Git.
• Familiarity with Kafka (MSK) and OpenSearch.
• Ability to automate repetitive work; strong troubleshooting, collaboration, and communication skills.
• Ability to manage complex platform operations, work at pace, and deliver migration targets; experience with Jira and agile ways of working.

Preferred qualifications

• Eight or more years in data platform engineering or related roles is preferred.
• Financial services or banking experience is a plus.

Location

• The role description lists Abu Dhabi as the location; it does not specify a workplace arrangement.