ashby
AI Inference Engineer
Baseten
San Francisco, USA
Full-time
Junior · 2+ years experience
Hybrid
Discovered 1 months ago
dockerpythonspark
Key Skills for This Role
dockerpythonspark
Full Job Posting
RESPONSIBILITIES
- Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects.
- Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion.
- Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customers
- Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs.
- Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and end-to-end execution.
- Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity.
- Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates.
REQUIREMENTS
- Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.
- 2+ years of professional work experience in a fast-paced, high-growth environment.
- Demonstrated experience with one or more general-purpose programming languages in a production-level environment, with a strong preference for Python.
- Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment.
- Strong communication skills, particularly on complex technical topics.
- Experience in building or optimizing AI/ML projects is highly valued.
BENEFITS
- Competitive compensation, including meaningful equity
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
- Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
- At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
- We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
About Baseten
Technology
Baseten is an inference platform for deploying and scaling open-source and custom AI models, providing GPU infrastructure optimized for low-latency production workloads.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Baseten
Technical Program Manager, Forward Deployed Engineering
Toronto, CAN
Full-time
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastruct
Discovered YesterdayView →
Software Engineer - Dedicated Inference
Montréal, CAN
MidFull-time
Baseten is seeking a software engineer to build developer tools for deploying and operating AI workloads in production. The work spans APIs, SDKs, command-line tools, observability, debugging, and full-stack product feat
Discovered 5 days agoView →
Software Engineer, Networking (Agent Infra)
New York City, USA
MidFull-time
Discovered 1 weeks agoView →
Product Finance
New York City, USA
Discovered TodayFull-time
Technical Program Manager, Forward Deployed Engineering
Toronto, CAN
Discovered YesterdayFull-time
Deal Strategy
New York City, USA
Discovered YesterdayFull-time
Recruiting Operations Specialist
San Francisco, USA
Discovered 3 days agoFull-time
Technical Product Marketing Manager
New York City, USA
Discovered 5 days agoFull-time
Software Engineer - Dedicated Inference
Montréal, CAN
Discovered 5 days agoFull-time
Software Engineer, Networking (Agent Infra)
New York City, USA
Discovered 1 weeks agoFull-time
Software Engineer, Compute and Isolation
New York City, USA
Discovered 1 weeks agoFull-time