Lead/Manager AI Infra Systems Engineering Team (Amsterdam)
Role Overview
Lead a team of AI Infra (Systems Engineers) at Together based out of our office in Amsterdam, you and the SRE team are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.
You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.
Key Skills for This Role
Full Job Posting
About the Role
Lead a team of AI Infra (Systems Engineers) at Together based out of our office in Amsterdam, you and the SRE team are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.
You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.
Responsibilities
- Be on an on-call (PagerDuty) rotation to respond to incidents that impact availability
- Manage, develop and coach the SRE Team.
- Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
- Build monitoring systems to ensure the highest quality service for our customers
- Design and implement operational processes (such as deployments and upgrades)
- Debug production issues across all services and levels of the stack
- Identify improvements for the product architecture from the reliability, performance and availability perspectives
- Plan the growth of Together AI’s infrastructure
Requirements
- 7+ years of professional SRE or related experience
- Ideally 2 years as a Lead SRE
- Bachelor's degree in Computer Science or a related field or equivalent work experience
- Expert knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
- Proficiency in programming/scripting languages
- Direct experience in monitoring and observability practices
- Advanced knowledge of cloud services
- Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts
About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy
About Together AI
Together AI operates a cloud platform for running, training, and fine-tuning open-source AI models, offering developers fast inference and scalable GPU infrastructure.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Together AI
Staff Software Engineer - AI Compute, Together Cloud
San Francisco, USA
Research Intern, Frontier Agents (Summer 2027)
San Francisco, USA
Together AI seeks a Ph.D. research intern to advance frontier agentic AI through research, experiments, and implementation. The intern will develop methods, datasets, evaluations, or infrastructure for reliable AI agents
Research Intern, Model Shaping (Summer 2027)
San Francisco, USA
Together AI seeks a research intern to develop model-shaping methods for open foundation models, including post-training, efficient neural-network training, and model evaluation. Candidates must be pursuing a relevant te
Technical Support Engineer (GPU Clusters) - US Weekends
, USA
Forward Deployed Engineer, Post-Training
, USA
Senior Partner Marketing Manager
San Francisco, USA
Senior Recruiter, GTM & Business
San Francisco, USA
Staff Software Engineer - AI Compute, Together Cloud
San Francisco, USA
Research Intern, Frontier Agents (Summer 2027)
San Francisco, USA
Research Intern, Model Shaping (Summer 2027)
San Francisco, USA
Research Intern, Frontier Agents (Summer 2027)
San Francisco, USA
