{bc}

Confluent Kafka Engineer-Bank

TAT IT TechnolgiesAbu Dhabi, UAE1 months agoMid-Senior
Mid-Seniorcontract

Skills

engineeringdesignproject management

About This Role

Overview

We have an Urgent requirement for Confluent Kafka Engineer with experience in real time data streaming for one of our banking client in Abu Dhabi, UAE

Strong experience in Confluent Kafka is MUST for this role

Design, develop, and maintain real-time data streaming solutions using Confluent Kafka—Must for this role

Develop and manage Kafka producers, consumers, topics, partitions, and schemas—Must for this role

Implement Kafka Streams, Kafka Connect, and integrations with external systems—-Must for this role

Job Summary

We are seeking a highly skilled Confluent Kafka Engineer to join our dynamic team.

The ideal candidate will be responsible for the development, User Acceptance Testing (UAT), and production support of our Confluent Kafka-based systems.

This role requires deep expertise in Kafka architecture, including Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.

The engineer will collaborate closely with cross-functional teams to ensure the smooth operation of our data streaming services and provide support across various environments.

Key Responsibilities

  • Design, develop, and implement Kafka-based solutions to meet business requirements, utilizing Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
  • Write and maintain high-quality code for Kafka producers, consumers, and stream processing applications.
  • Develop and manage Kafka connectors for seamless integration with external systems, ensuring data consistency and reliability.
  • Utilize Kafka Streams for real-time processing of streaming data, transforming and enriching data as it flows through the pipeline.
  • Employ KSQLDB for stream processing tasks, including real-time analytics and transformations.
  • Collaborate with data engineers, software developers, and DevOps teams to integrate Kafka solutions with existing systems.
  • Ensure all Kafka-based solutions are scalable, secure, and optimized for performance.

User Acceptance Testing (UAT)

  • Develop and execute UAT plans to validate Kafka solutions, including components such as Kafka Streams, KSQLDB, and Kafka Connect, before deployment to production.
  • Work closely with QA teams to identify and resolve defects during the UAT phase.
  • Ensure all UAT activities comply with the organization’s standards and best practices.
  • Provide detailed reports on UAT outcomes and work with developers to implement necessary fixes.

Production Support

  • Monitor and maintain Kafka clusters, including components like Confluent Control Center, to ensure high availability and reliability of data streaming services.
  • Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity, including issues specific to Kafka Streams, KSQLDB, and Kafka Connect.
  • Perform routine maintenance tasks such as patching, upgrades, and backups for Kafka clusters and associated components.
  • Implement monitoring solutions to proactively identify and mitigate potential production issues, leveraging Confluent Control Center for comprehensive cluster visibility.
  • Provide 24/7 support for production systems, including participation in on-call rotation.

Education

Bachelor’s degree in Computer Science, Information Technology, or a related field.

Experience

  • 3+ years of hands-on experience with Apache Kafka and Confluent Kafka in a production environment, including experience with Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
  • Proven experience in Kafka development, including producer and consumer API, stream processing, and connector development.
  • Experience with Kafka cluster management, including setup, configuration, monitoring, and troubleshooting.
  • Familiarity with distributed systems, microservices architecture, and event-driven design patterns.
  • Experience with cloud platforms (e.g., AWS, Azure) and containerization (Kubernetes) is a plus.

Technical Skills

  • Proficiency in programming languages such as Java, Python, or Scala.
  • Strong knowledge of Kafka internals, including brokers, zookeepers, topics, partitions, and offsets.
  • Experience with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks (e.g., Log4j, ELK Stack).
  • Proficiency in using Confluent Control Center for monitoring, managing, and optimizing Kafka clusters.
  • Expertise in Kafka Streams for building scalable, fault-tolerant stream processing applications.
  • Experience with KSQLDB for real-time processing and analytics on Kafka topics.
  • Strong understanding of Kafka Connect for integrating Kafka with external data sources and sinks.
  • Understanding of networking, security, and compliance aspects related to Kafka.
  • Familiarity with CI/CD pipelines and automation tools (e.g., Jenkins, GitLab CI).

Skills

bank,streams,kafka,confluent

Your resume, rewritten for this exact role.

Sign up free — Base Career tailors your CV to this job description in 60 seconds.

01 / 05

Resume Tailored to This Job

Resume Tailored to This Job

Your keywords, structure, and story — rewritten to match this exact role and pass ATS filters.

Get My Free Resume

Free · No card · 60 seconds

02 / 05

Cover Letter for This Role, Done

Cover Letter for This Role, Done

Job-specific cover letters written in Gulf professional tone — ready in seconds, not hours.

Get My Cover Letter

Free · No card · 60 seconds

03 / 05

See How Well You Fit This Role

See How Well You Fit This Role

AI match score with clear reasons — know your fit before investing time in the application.

Check My Fit Score

Free · No card · 60 seconds

04 / 05

Apply in One Click

Apply in One Click

Autofill any application form on Workday, LinkedIn, Bayt, Greenhouse — with your tailored content.

Start Applying Faster

Free · No card · 60 seconds

05 / 05

Track It. Follow Up at the Right Time.

Track It. Follow Up at the Right Time.

Visual pipeline for every application with AI-timed follow-up reminders so nothing slips.

Track My Applications

Free · No card · 60 seconds

Similar Jobs

Confluent Kafka Engineer - Development, UAT, and Production Support

FR Consultancy (Middle East) · Abu Dhabi Emirate

Mid-Seniorfulltime

Role: Confluent Kafka Engineer - Development, UAT, and Production Support Type: Full-Time Location: Abu Dhabi, United Arab Emirates Skills: Apache Kafka, Confluent Kafka, Kafka Streams, Kafka Connect, ksqlDB, Core Java /

Skills

PythonSQLJava

2.2K+

Cover Letters & Follow-ups

1.8K+

Resumes Tailored

190.5K+

Jobs Tracked

Trusted by professionals at

PwC//
Emaar//
KPMG//
Noon//
Amazon AWS//
Talabat//
Deloitte//
Emirates//
Careem//
Aramex//
McKinsey//
Property Finder//
Majid Al Futtaim//
Chalhoub Group//
PwC//
Emaar//
KPMG//
Noon//
Amazon AWS//
Talabat//
Deloitte//
Emirates//
Careem//
Aramex//
McKinsey//
Property Finder//
Majid Al Futtaim//
Chalhoub Group//
AI Job Platform

Stop applying blindly. Start getting hired.

Base Career automates the hardest parts of job searching — apply smarter, not harder.

AI Resume in 60s

Your resume rewritten for this exact role using the job description as the brief.

ATS-Optimized

Get past automated screening filters with the right keywords matched to each job.

Application Tracker

Track every job, follow-up, and interview in one visual kanban board.

Free plan · No credit card required