Senior Machine Learning Engineer, Features

High-Performance Feature Engineering & Infrastructure: Architect, build, and maintain low-latency, high-throughput feature pipelines — batch, real-time streaming, and point-in-time correct historical features — to power our real-time bidding systems.

Advanced Embeddings & Generative AI Integration: Leverage LLMs and deep learning models to extract rich contextual and user-level embeddings into the core feature store/serving system, optimizing embedding generation, indexing, and online retrieval for sub-millisecond serving SLAs.

Model Training Pipeline Optimization: Own and continuously enhance Cognitiv's ad model training pipelines, improving training speed, resource utilization, and throughput for large-scale deep learning models.

System Scalability, Reliability & Efficiency: Establish technical standards for monitoring, testing, and CI/CD across feature and training infrastructure to ensure robust system SLAs/SLOs.

Partner with Modeling & Data Science: Translate complex signals into production-ready features that directly boost model performance (e.g., CTR/CVR prediction).

Must haves:

3-5+ years of hands-on Machine Learning Infrastructure / Data Platform experience supporting data-intensive platforms, including large-scale data pipelines, streaming systems, and storage layers.

Proficiency in one or more core programming languages — Python, Java, or Scala — for building, maintaining, and scaling robust ML and data pipelines.

Strong expertise in modern big data technologies such as Apache Spark, Apache Flink, Apache Kafka, and other distributed data processing frameworks.

Excellent team communication, cross-functional collaboration, and problem-solving skills, with a track record of partnering effectively with modeling and engineering teams.

Willing to work onsite Monday/Tuesday/Wednesday in San Mateo, CA.

Nice to haves:

Domain expertise in AdTech.

Hands-on experience with PyTorch for model architecture, training pipeline acceleration, or distributed training.

Proficiency with cloud & infrastructure technologies, including AWS/GCP, as well as containerization and orchestration platforms like Kubernetes (K8s) and Docker.

Competitive programming background, such as awards or achievements in OI (Olympiad in Informatics) or ACM/ICPC.

Tech Stack: Python, Java, Kafka, Flink, Spark, PyTorch, Kubernetes, AWS

First 30 days:

Ramp quickly on Cognitiv's feature pipelines, training infrastructure, and RTB systems.

Build strong context on current architecture, data flows, and known bottlenecks.

Establish relationships with Modeling, Data Science, and Infrastructure teams.

Identify early opportunities to improve pipeline reliability, training efficiency, or serving latency.

First 60 days:

Independently own at least one core feature pipeline, embedding service, or training subsystem.

Ship a first measurable improvement — e.g., reduced serving latency, faster training throughput, or expanded monitoring/CI-CD coverage.

Align with Modeling and Data Science on the feature and training roadmap.

Begin influencing technical direction for feature and training infrastructure.

First 90 days:

Fully own a core area of the platform, such as embedding generation/retrieval, streaming infrastructure, or training pipeline performance.

Deliver measurable business impact — e.g., reduced feature or serving latency, faster model training, or improved uptime/SLA adherence.

Redesign or scale at least one key system to handle growing data volume or model complexity.

Operate autonomously as a trusted technical partner to Modeling, Data Science, and Engineering.

Festiv – We make work fun with cross-team games, events, and creative team bonding.

Responsiv – You’ll be close to clients and leadership, influencing real outcomes.

Inclusiv – Diversity and individuality are celebrated across all levels.

Inventiv – We reward curiosity and embrace bold ideas.

Transformativ – We support your growth with training, mentorship, and flexibility.

Collaborativ – We operate across coasts, connected by purpose and teamwork.