Senior Software Engineer, Inference
Role Overview
Join the engineering team between research and Applied teams to bring new AI model capabilities from proof of concept to production APIs.
Build robust, well-documented products that serve production traffic at scale.
Key Skills for This Role
Full Job Posting
About AssemblyAI
AssemblyAI builds Voice AI models for voice applications, serving large-scale inference traffic and audio processing.
The company describes a lean team with substantial individual ownership and customers across multiple industries.
About the role
Join the engineering team between research and Applied teams to bring new AI model capabilities from proof of concept to production APIs.
Build robust, well-documented products that serve production traffic at scale.
What you will do
- Design and ship customer-facing APIs exposing new model capabilities, from prototype through launch and iteration.
- Scale inference infrastructure to support more than one million API users.
- Partner with researchers to productionize techniques with suitable latency, reliability, and customer ergonomics.
- Work with customers and Applied teams to inform product design and research direction.
- Contribute to backend services, inference infrastructure, SDKs, and internal tooling as needed.
What you will need
- Strong backend engineering experience, including production machine-learning infrastructure and/or customer-facing APIs.
- Comfort with ambiguity and mismatched research and product timelines.
- Curiosity about AI/ML and willingness to understand model behavior for sound engineering decisions.
- Strong collaboration skills with researchers, applied engineers, and customers.
Pay transparency
- The stated U.S. salary range is $190,000–$225,000; the posting does not specify a compensation cadence.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at AssemblyAI
Senior GTM AI Engineer
New York City, USA
AssemblyAI is hiring its first Senior GTM AI Engineer to build production pipelines, internal tools, and AI agents for account targeting, sales outreach, CRM operations, and usage monitoring. The role requires strong Pyt
Digital Native AI Account Executive
New York City, USA
Digital Native AI Account Executive
London, GBR
Digital Native AI Account Executive
San Francisco, USA
Head of GTM, Europe
London, GBR
Finance Engineer
North Salt Lake, USA
Senior GTM AI Engineer
New York City, USA
Head of Sales, Digital Native
San Francisco, USA
Security Operations Engineer
North Salt Lake, USA