Senior Data Engineer (Data Platform Databricks)

Project Description

Data Governance & Control

• Define and implement data governance frameworks covering:
• o Data ownership, stewardship, and accountability
• o Data quality rules, controls, and monitoring
• o Metadata management, data cataloging, and lineage
• Ensure compliance with regulatory, risk, and internal governance requirements across IB&M data assets
• Partner with Risk, Compliance, and Audit teams to support regulatory use cases and thematic reviews

Data Platform Leadership

• Lead the design and evolution of the IB&M Data Platform, aligned with enterprise standards
• Drive governance capabilities across the Lakehouse architecture (ADLS, Databricks, Delta Lake)
• Define platform standards for:
• o Data ingestion (batch / micro-batch / streaming)
• o Schema enforcement and validation
• o Data modeling and standardization
• o Secure data access and entitlements

Architecture & Engineering

• Act as a technical authority for data architecture decisions within IB&M
• Review and guide solution designs produced by internal teams and vendors
• Ensure scalability, performance, reliability, and cost efficiency of the platform
• Support hybrid architectures (Cloud + On Prem) where required by business or regulatory constraints

Enablement & Collaboration

• Work closely with Data Engineering, Analytics, BI, AI/ML, and Business teams
• Enable self service analytics while maintaining strong governance controls
• Provide technical guidance, best practices, and design reviews across IB&M initiatives
• Support onboarding of new use cases onto the GM / IB&M Data Platform

Mandatory Skills Description

• 10+ years of experience in Data Engineering, Data Platforms, or Data Architecture
• Proven experience leading data governance initiatives in large, regulated environments (Banking/Financial Services preferred)
• Strong background supporting Global Markets / Investment Banking data domains is highly desirable

Technical Skills

• Strong hands-on experience with:

O Azure Data Lake (Adls)

• o Databricks / Delta Lake / Lakehouse architectures
• o Data quality, schema enforcement, and validation frameworks
• Experience with data cataloging and governance tools (e.g., Unity Catalog, Informatica Axon or similar)
• Solid understanding of:
• o Data modeling (analytical and canonical models)
• o Metadata management and lineage
• o Secure data access and entitlements
• Good understanding of AI/ML and analytics enablement within governed data platforms

Nice-To-Have Skills Description

• Strong ownership mindset with ability to work independently
• Excellent stakeholder management and communication skills
• Ability to translate regulatory and business requirements into technical solutions
• Comfortable working in complex, multi vendor, enterprise environments