Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
QuantumGate is dedicated to developing and commercializing cutting-edge post-quantum cryptographic solutions. Our mission is to safeguard enterprise digital environments through innovative protocols and applications that address the evolving challenges of the post-quantum era.
Key Skills for This Role
Full Job Posting
Overview
QuantumGate is dedicated to developing and commercializing cutting-edge post-quantum cryptographic solutions.
Our mission is to safeguard enterprise digital environments through innovative protocols and applications that address the evolving challenges of the post-quantum era.
We are seeking a talented and motivated Data Engineer to join our fast-growing ML-team.
The ideal candidate has strong experience with distributed data processing, NoSQL databases, and modern data lake technologies.
You will play a key role in designing and maintaining scalable data pipelines that power business intelligence, analytics, and machine learning initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Apache Spark and/or similar solutions.
- Manage and optimize large datasets stored in Apache Iceberg tables.
- Design, build, and optimize data infrastructure.
- Integrate data from various sources including MongoDB, APIs, and flat files.
- Optimize data processing workflows for batch and real-time analytics.
- Implement and enforce data governance, data quality, and security best practices.
- Troubleshoot and resolve data-related issues in dev/production environments.
- Work closely with data scientists, analysts, and product teams to understand data needs and deliver efficient solutions.
- Monitor pipeline performance and troubleshoot data quality issues.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or related field.
- 3+ years of experience in data engineering or related roles.
- Strong hands-on experience with:
- o Apache Spark (PySpark, Scala, or Java)
- o MongoDB (data modeling, aggregation framework, replication)
- o Apache Iceberg or other data lake table formats (Delta Lake, Hudi)
- Proficient in SQL and at least one programming language (Python, Scala, or Java).
- Experience with data pipeline orchestration tools (e.g., Airflow).
- Understanding of data warehousing concepts (star schema, partitioning).
- Familiarity with cloud platforms such as AWS or Azure.
- Nice to have qualifications
- Experience with stream processing (e.g., Kafka, Flink).
- Experience with Kubernetes for containerized data workloads.
- Familiarity with CI/CD practices and infrastructure as a code (e.g., Terraform)
- Join us to drive innovation and shape the future of technology!
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at QuantumGate
Senior Debugging Engineer
Abu Dhabi, UAE
QuantumGate is dedicated to developing and commercializing cutting-edge post-quantum cryptographic solutions. Our mission is to safeguard enterprise digital environments through innovative protocols and applications that
Senior Data Scientist
Abu Dhabi Emirate, UAE
QuantumGate is a startup within VentureOne, supported by the Advanced Technology Research Council ( ATRC ) and its research arm, the Technology Innovation Institute ( TII ). We specialize in developing and commercializin
Intern (Sales)
Abu Dhabi, UAE
QuantumGate is a cybersecurity venture launched by VentureOne, dedicated to developing post-quantum data security products and applications that safeguard enterprise digital environments. Our innovative solutions, includ
Business Development Manager
Abu Dhabi Emirate, UAE
QuantumGate is a cybersecurity venture launched by VentureOne, dedicated to developing post-quantum data security products and applications that safeguard enterprise digital environments. Our innovative solutions, includ
DevOps Engineer
Abu Dhabi Emirate, UAE
QuantumGate is a startup within VentureOne, supported by the Advanced Technology Research Council ( ATRC ) and its research arm, the Technology Innovation Institute ( TII ). We specialize in developing and commercializin
Technical Project Manager
Abu Dhabi Emirate, UAE
QuantumGate is dedicated to developing and commercializing cutting-edge post-quantum cryptographic solutions. Our mission is to safeguard enterprise digital environments through innovative protocols and applications that
Senior Mobile App Engineer - iOS & Android Development
Abu Dhabi Emirate, UAE
QuantumGate is a cybersecurity venture focused on post-quantum security solutions, including cryptographic migration tools, passwordless authentication, and network access with zero-trust principles. Our mission is to em
Senior Systems Software Engineer
Abu Dhabi Emirate, UAE
About Us: QuantumGate is dedicated to developing and commercializing cutting-edge post-quantum cryptographic solutions. Our mission is to safeguard enterprise digital environments through innovative protocols and applica
Senior Debugging Engineer
Abu Dhabi, UAE
Senior Data Scientist
Abu Dhabi Emirate, UAE
Intern (Sales)
Abu Dhabi, UAE
Business Development Manager
Abu Dhabi Emirate, UAE
DevOps Engineer
Abu Dhabi Emirate, UAE
Technical Project Manager
Abu Dhabi Emirate, UAE
Senior Mobile App Engineer - iOS & Android Development
Abu Dhabi Emirate, UAE
Senior Systems Software Engineer
Abu Dhabi Emirate, UAE