AI Engineer
Key Skills for This Role
Full Job Posting
RESPONSIBILITIES
- Build and ship agentic product experiences, including chat-style and assistant-like interfaces, from prototype to GA.
- Design the harnesses, execution flows, and guardrails that make AI systems reliable in production.
- Build internal automation and AI tooling that measurably increases the velocity of engineering, research, and go-to-market teams.
- Partner with research engineers to scope product opportunities out of internal research workflows and turn them into customer-facing features.
- Define and instrument evals so you know whether a change actually improved output quality.
- Work throughout the stack (API layer, backend, agent orchestration, frontend) to implement features end to end.
- Use Baseten's own training and inference products yourself to develop intuition around customer workflows.
- Identify where AI can replace manual process across the company and build the thing rather than write the proposal.
- Fix bugs and resolve customer issues with urgency.
REQUIREMENTS
- 5+ years of experience building and shipping software applications.
- Demonstrated experience building AI or LLM-powered products, agents, or agentic workflows that real users depend on.
- Strong software engineering fundamentals and the ability to clear a real technical bar, not just prompt well.
- Ability to build accurate mental models of how systems work under the hood, including the models and harnesses you're building on.
- Proficiency in Python, with fluency in at least one other language.
- Comfort working autonomously in a fast-moving environment with limited structure.
- Ability to move between customer-facing product work and internal tooling and automation.
- Strong communication skills, with the ability to bridge technical depth and business needs.
- NICE TO HAVE
- Experience as a founding engineer or early employee at a startup.
- Experience building evals, agent observability, or tooling for non-deterministic systems.
- Familiarity with agent frameworks and harnesses (LangChain, Claude Code, Codex, OpenCode, MCP).
- Experience with model development methods like supervised fine-tuning, reinforcement learning, synthetic data generation, LoRA, and full fine-tunes.
- Frontend fluency.
BENEFITS
- Competitive compensation, including meaningful equity
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
- Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
- At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
- We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
About Baseten
Baseten is an inference platform for deploying and scaling open-source and custom AI models, providing GPU infrastructure optimized for low-latency production workloads.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Baseten
Software Engineer - Dedicated Inference
Montréal, CAN
Baseten is seeking a software engineer to build developer tools for deploying and operating AI workloads in production. The work spans APIs, SDKs, command-line tools, observability, debugging, and full-stack product feat
Software Engineer, Networking (Agent Infra)
New York City, USA
Software Engineer, Storage Systems (Agent Infra)
New York City, USA
Technical Product Marketing Manager
New York City, USA
Software Engineer - Dedicated Inference
Montréal, CAN
Software Engineer, Networking (Agent Infra)
New York City, USA
Software Engineer, Compute and Isolation
New York City, USA
Software Engineer, Storage Systems (Agent Infra)
New York City, USA
Product Platform - Product Engineer
New York City, USA
Product Platform: Backend Engineer
New York City, USA
Software Engineer - Partner Platform
San Francisco, USA
