Lead Data Engineer
Role Overview
Lead Data Engineer in Barclays Corporate Digital Banking, within Technology; the description states the role is based in Glasgow.
The role designs and develops real-time streaming solutions for scalable, low-latency platforms supporting critical business processes.
The post combines technical direction and architecture contributions with ongoing hands-on development.
Key Skills for This Role
Full Job Posting
Role overview
Lead Data Engineer in Barclays Corporate Digital Banking, within Technology; the description states the role is based in Glasgow.
The role designs and develops real-time streaming solutions for scalable, low-latency platforms supporting critical business processes.
The post combines technical direction and architecture contributions with ongoing hands-on development.
Required technical experience
- Experience with real-time streaming applications using Kafka Streams, including KStream and KTable concepts.
- Experience with Apache Flink, including stateful processing, checkpointing and fault-tolerant approaches.
- Experience with high-throughput, low-latency pipelines processing and transforming large data volumes.
Valued technical experience
- Financial messaging standards such as ISO 20022 or MT, and parsing solutions such as Prowide Core, are valued.
- Kafka Connect, AVRO and Confluent Schema Registry experience is valued.
- Flink SQL or Table API experience for stream-processing use cases is valued.
Data engineering duties
- Build and maintain data architectures and pipelines that transfer and process durable, complete and consistent data.
- Design data warehouses and lakes appropriate to data volumes and velocity and required security measures.
- Develop processing and analysis algorithms suited to data complexity and volumes.
- Collaborate with data scientists to build and deploy machine-learning models.
Technical leadership and governance
- Contribute to architecture, engineering standards and ways of working while staying close to the codebase.
- Guide technical direction and specialists, collaborate with stakeholders, and contribute to risk assessment, controls and continuous improvement.
Role expectations
The posting includes Vice President expectations covering strategic contributions, recommendations for change, risk and control management, stakeholder advice and technical leadership; leadership duties depend on whether the position manages a team.
Assessment may cover risk and controls, change and transformation, business acumen, strategic thinking, digital and technology, and job-specific technical skills.
Requirements
- Experience working with real-time streaming applications using Kafka Streams, including KStream and KTable concepts.
- Experience working with Apache Flink solutions, including stateful processing, checkpointing and fault-tolerant approaches.
- Experience with high-throughput, low-latency data pipelines that process and transform large volumes of data.
- Experience with financial messaging standards such as ISO 20022 or MT and parsing solutions such as Prowide Core is valued.
- Experience integrating distributed systems using Kafka Connect and working with AVRO schemas and Confluent Schema Registry is valued.
- Experience applying Flink SQL or Table API to stream-processing use cases is valued.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Barclays
High Yield Credit Research Analyst
, USA
Operations Analyst - Enhanced Due Diligence/Exits
Chennai, IND
KYC Senior Analyst
Pune, IND
Barclays Internal Audit - Markets - Credit AVP
, USA
Assitant Manager Fraud Analytics
Gurugram, IND
Assistant Manager Fraud Analytics
Noida, IND
Customer Journey - Software Engineer - AVP
Bengaluru, IND
Customer Service Advisor
Glasgow, GBR