Manager, AI Engineer

Role and team

What you will do

• Partner across engineering, research, program management, and product teams to deliver AI-powered products.
• Build and support AI components for foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
• Use technologies including AWS Ultraclusters, Hugging Face, vector databases, NeMo Guardrails, and PyTorch.
• Develop LLM optimizations for production-system scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap for foundational AI systems.

Basic qualifications

• Relevant bachelor’s degree plus at least 4 years developing AI/ML algorithms or technologies, or relevant master’s degree plus at least 2 years.
• At least 4 years programming with Python, Go, Scala, or Java.

Preferred qualifications and strengths

• Preferred: 6 years deploying scalable, responsible AI solutions on AWS, Google Cloud, Azure, or equivalent private cloud.
• Preferred: experience developing, delivering, and supporting AI services and AI/ML technologies such as LLM inference, similarity search, vector databases, guardrails, or memory.
• Preferred: experience optimizing training and inference software for hardware utilization, latency, throughput, and cost.
• The ideal candidate has strong engineering and mathematics foundations, follows AI research, and applies novel techniques judiciously in production.

Workplace

• Hybrid model with 3 days in the office per week.

Compensation

• Expected annual salary range is $173,000 to $197,400, with eligibility for performance-based incentive compensation.

Benefits

• Benefits include dependent coverage, a one-time work-from-home allowance, mental health coverage, and annual tuition subsidies.