Data Engineer (Detect & Track Distillation)
Role Overview
Our ML teams train models on datasets derived from large volumes of raw, unstructured data. Model quality depends directly on data quality, and today that data is handled largely by hand.
As a Data Engineer, operating out of Paris, Lausanne, or Zurich, you will own the data layer that feeds the team's models, from raw field logs or public datasets through curated, versioned, training-ready datasets. You will manage terabytes of raw, unstructured data and turn it into clean, documented, versioned datasets, so that the modelers spend their time designing and training models, not waiting on data loaders or wrangling corrupted files. You join at an early stage with real influence over how field and public data gets processed for deep-learning pipelines.
Key Skills for This Role
Full Job Posting
About Us
Harmattan AI is a next-generation defense prime building autonomous and scalable defense systems. Following the close of a $200M Series B, valuing the company at $1.4 billion, we are expanding our teams and capabilities to deliver mission-critical systems to allied forces.
Our work is guided by clear values: building technologies with real-world impact, pursuing excellence in everything we do, setting ambitious goals, and taking on the hardest technical challenges. We operate in a demanding environment where rigor, ownership, and execution are expected.
ABOUT THE ROLE
Our ML teams train models on datasets derived from large volumes of raw, unstructured data. Model quality depends directly on data quality, and today that data is handled largely by hand.
As a Data Engineer, operating out of Paris, Lausanne, or Zurich, you will own the data layer that feeds the team's models, from raw field logs or public datasets through curated, versioned, training-ready datasets. You will manage terabytes of raw, unstructured data and turn it into clean, documented, versioned datasets, so that the modelers spend their time designing and training models, not waiting on data loaders or wrangling corrupted files. You join at an early stage with real influence over how field and public data gets processed for deep-learning pipelines.
RESPONSIBILITIES
- Ingestion Pipeline: Ingest, decode, and store raw, unstructured field data (video and other sensor streams) from field logs into efficient, controlled formats.
- Multimodal Alignment: Align multiple data streams temporally and spatially so paired data is usable for training.
- Curation: Transfer both ingested data and public datasets into high-value data, including parsing, filtering, de-duplication and revision.
- Data & Labeling Requirements: Define which data to gather and what and how to label it, and own the dataset-construction workflow and labeling tooling. Coordinate with the teams responsible for data gathering and labeling.
- Dataset Construction: Build task-specific datasets for the team’s training and evaluation needs, in collaboration with acquisition, annotation and product teams.
- Versioning & Lineage: Version datasets and maintain lineage so training runs stay reproducible.
- Storage & Formats: Store data in efficient, training-ready formats (such as columnar or sharded formats) and manage storage tiering to balance cost and latency as datasets grow.
- Efficient Delivery: Deliver clean, documented datasets and the corresponding tools for loading to keep training from being I/O-bound, shaping their structure with the modelers.
- CANDIDATE REQUIREMENTS
- Educational Background: A degree in a STEM field, or equivalent practical experience. Practical data engineering experience matters more than the specific degree.
- Data Pipelines at Scale: Built and maintained pipelines for unstructured data at scale (video, images, or sensor data), covering ingestion, decode, storage, curation, and versioning.
- Engineering: Strong in Python and data engineering, and comfortable optimizing data loaders for common training frameworks (for example PyTorch).
- Bonus: Multimodal sensor data, labeling or dataset construction for ML, dataset versioning tooling, and distributed data processing tooling.
- Attributes: Systematic, quality-minded, pragmatic, and service-oriented so the modelers are enabled, with a knack for taming messy data via automation.
- Commitment: 100% dedication to Harmattan AI's mission of providing a defensive edge to allied nations through ethical, high-impact technology.
- We look forward to hearing how you can help shape the future of autonomous defense systems at Harmattan AI.
About Harmattan AI
Harmattan AI is a French defense technology company that develops autonomous drone systems and AI-powered defense solutions. Founded in 2024, the company designs scalable and attritable systems for military applications for European and allied nations.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Harmattan AI
Flight Operations Engineer
, UAE
Harmattan AI seeks a Flight Operations Engineer to bridge R&D and the field for autonomous defense systems. You will plan and execute flight test campaigns, lead live demonstrations for defense partners, and train end-us
Flight Operations Engineer
, UAE
Harmattan AI seeks a flight operations engineer to test and validate autonomous systems, lead flight demonstrations, train defense partners, and support deployment in operational environments. Candidates need 2–5 years o
Flight Operations Engineer
Abu Dhabi, UAE
Harmattan AI is seeking a Flight Operations Engineer to validate autonomous systems, demonstrate them to defense partners, train users, and support deployments. Candidates need 2–5 years in flight operations, flight test
Legal & Contract Manager MEA
, UAE
Harmattan AI is seeking a commercially minded in-house legal professional to advise the business, especially across Arabic-speaking markets. The role covers commercial contracts, procurement, regulated defence and AI mat
Legal Counsel
Abu Dhabi, UAE
Harmattan AI is seeking a commercially minded legal counsel to support its business, with a focus on Arabic-speaking markets and regulated defense technology. The role requires a qualified lawyer with around five years o
Legal Counsel
, UAE
Harmattan AI seeks a commercially minded Legal Counsel to support sales and business teams, with a focus on Arabic-speaking markets and regulated defense technology. The role negotiates commercial and procurement agreeme
Flight Operations Engineer
, UAE
Flight Operations Engineer
, UAE
Flight Operations Engineer
, UAE
Flight Operations Engineer
Abu Dhabi, UAE
Flight Operation Engineer
Austin, USA
Legal & Contract Manager MEA
, UAE
Legal Counsel
Abu Dhabi, UAE
Legal Counsel
, UAE