Engineering Manager, ML Training Infrastructure

RESPONSIBILITIES

• Lead engineers and foster a collaborative and innovative environment.
• Manage and nurture a group of around 7–8 engineers, offering technical vision, mentorship, professional growth, and effective project delivery.
• Establish and articulate the technical vision and future roadmap for machine learning training infrastructure.
• Direct the architecture, construction, and operation of resilient systems supporting massive ML model training workloads.
• Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads.
• Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.
• Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools.
• Enhance workflow orchestration platforms by deploying and supporting solutions such as Airflow, Temporal, and similar pipeline frameworks.
• Elevate the system resilience, monitoring insights, elasticity, and operational productivity of our ML training stack.
• Work closely alongside AD/ADAS, Woven City, and internal platform partners to gather feature requests and ship infrastructure solutions that accelerate development.
• Partner with cross-functional engineering groups to specify platform interfaces, APIs, system architectures, and operational standards.
• Translate high-level organizational objectives and user requirements into concrete, executable engineering milestones with product leads.
• Institute rigorous software practices across implementation, code reviews, automated testing, continuous deployment, and live site management.
• Engage in production support workflows, lead post-incident reviews, and champion system refinements based on operational findings.
• Balance immediate client feature requests against long-term architectural stability, technical hygiene, and system maintainability.
• Foster an inclusive, highly collaborative, and excellence-driven engineering culture throughout Woven by Toyota.

MINIMUM QUALIFICATIONS

NICE TO HAVES