Senior Technical Program Manager, AI Inference
Key Skills for This Role
Full Job Posting
What You’ll Be Doing
Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs.
Partner with hardware and software engineering leads to align library development with new and upcoming hardware timelines.
Coach teams on agile practices and run the rituals that keep programs on track.
Build and maintain metrics that surface risks early and support decisions with real data.
Communicate program status and technical context clearly to engineering teams and senior leadership alike.
Align global, cross-disciplinary teams spanning hardware, software, and product.
Identify process gaps and implement improvements that increase delivery quality and team efficiency.
Moderate complex technical discussions and drive them to clear, documented conclusions.
What We Need to See
- BS degree in Computer Science, Artificial Intelligence, or equivalent experience plus 10 years of experience leading global technical programs.
- Solid knowledge of software engineering standard methodologies, hardware bring-up processes, and enterprise quality standards.
- Proficiency with Scaled Agile frameworks and program tracking tools.
- Demonstrated ability to resolve resource conflicts, unblock teams, and drive alignment at every level of the organization.
- Clear, compelling communication skills across both technical and business audiences.
Ways to Stand Out from the crowd
- Proven experience in machine learning, deep learning, GPU technology, or AI infrastructure.
- Experience shipping production AI software or co-managing software-hardware programs end to end.
- A record of building scalable program management practices in growing engineering organizations.
- Mentorship instincts — the kind of person who invests in the teams around them.
- Familiarity with open-source inference frameworks or model optimization tooling.
- You will also be eligible for equity and benefits .
- This posting is for an existing vacancy.
- NVIDIA uses AI tools in its recruiting processes.
About NVIDIA
Computing platform company for AI and accelerated graphics.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at NVIDIA
Technical Learning Content Development Intern, Physical AI — Summer 2027
, USA
Senior SoC Architect, RAS
, USA
Manager, Personnel Program Management
, USA
Senior Network Solution Engineer (Weekend Coverage)
, USA
Hardware Validation Engineer
, USA
Senior Software and System Architect
, USA
Senior Machine Learning Engineer, AI Safety Evaluations
, USA
Senior Firmware Engineer
, USA
Technical Learning Content Development Intern, Physical AI — Summer 2027
, USA
