Kafka Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Design and implement Kafka solutions, manage data pipelines, and provide production support while ensuring scalability and reliability of streaming data.
Key Skills for This Role
Full Job Posting
Overview
- Development:
- Design, develop, and implement Kafka-based solutions to meet business requirements, utilizing Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
- Write and maintain high-quality code for Kafka producers, consumers, and stream processing applications.
- Develop and manage Kafka connectors for seamless integration with external systems, ensuring data consistency and reliability.
- Utilize Kafka Streams for real-time processing of streaming data, transforming and enriching data as it flows through the pipeline.
- Employ KSQLDB for stream processing tasks, including real-time analytics and transformations.
- Collaborate with data engineers, software developers, and DevOps teams to integrate Kafka solutions with existing systems.
- Ensure all Kafka-based solutions are scalable, secure, and optimized for performance.
User Acceptance Testing (UAT)
- Develop and execute UAT plans to validate Kafka solutions, including components such as Kafka Streams, KSQLDB, and Kafka Connect, before deployment to production.
- Work closely with QA teams to identify and resolve defects during the UAT phase.
- Ensure all UAT activities comply with the organization’s standards and best practices.
- Provide detailed reports on UAT outcomes and work with developers to implement necessary fixes.
Production Support
- Monitor and maintain Kafka clusters, including components like Confluent Control Center, to ensure high availability and reliability of data streaming services.
- Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity, including issues specific to Kafka Streams, KSQLDB, and Kafka Connect.
- Perform routine maintenance tasks such as patching, upgrades, and backups for Kafka clusters and associated components.
- Implement monitoring solutions to proactively identify and mitigate potential production issues, leveraging Confluent Control Center for comprehensive cluster visibility.
- Provide 24/7 support for production systems, including participation in on-call rotation.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Dicetek LLC
Data Classification -Senior Consultants
Abu Dhabi, UAE
We are seeking experienced Senior Consultants specializing in Data Classification with expertise in Microsoft Purview and equivalent data privacy tools. As a key member of our team, you will play a critical role in helpi
Infrastructure Engineer
Dubai, UAE
Job Summary We are seeking an experienced Infrastructure Engineer to manage and support enterprise IT infrastructure across on-premises and cloud environments. The ideal candidate will have hands-on experience in server
Data Engineer- Data Cleansing & Quality (DQ)
Abu Dhabi, UAE
We are looking for a skilled Data Engineer specializing in Data Cleansing & Quality (DQ) to join our dynamic team. As a Data Engineer, you will be responsible for ensuring the accuracy, consistency, and reliability of ou
Data Modeler- Data Modelling & Architecture
Abu Dhabi, UAE
We are currently seeking a skilled Data Modeler to join our team and support our data modelling and architecture efforts. If you have experience with tools such as Erwin, ER Studio, or similar data modelling tools, we'd
Data Management & Governance - Consultant
Abu Dhabi, UAE
Are you passionate about data management and governance? Do you have experience with tools like Informatica IDMC and other data management and governance toolsets? If so, we're looking for someone like you to join our te
Specialist Documentation (Banking)
Dubai, UAE
Prepare facility letters and security documents for conventional and Islamic facilities with accuracy and within agreed timelines. Review executed standard and non-standard documents, verify signatory authority/capacity
SRE - Appzone + Dotnet
Abu Dhabi, UAE
We’re looking for a talented Site Reliability Engineer (SRE) to keep our systems running smoothly, reliably, and at scale. Through smart automation , deep observability , and a calm head in a crisis, you’ll help us balan
Technical Project Manager
Abu Dhabi, UAE
Experience 12+ years Role Summary The Technical Project Manager is responsible for end‑to‑end delivery of complex technology programs within a regulated banking environment. The role leads multi‑vendor and internal IT te
Data Classification -Senior Consultants
Abu Dhabi, UAE
Infrastructure Engineer
Dubai, UAE
Data Engineer- Data Cleansing & Quality (DQ)
Abu Dhabi, UAE
Data Modeler- Data Modelling & Architecture
Abu Dhabi, UAE
Data Management & Governance - Consultant
Abu Dhabi, UAE
Specialist Documentation (Banking)
Dubai, UAE
SRE - Appzone + Dotnet
Abu Dhabi, UAE
Technical Project Manager
Abu Dhabi, UAE