Staff Software Engineer - Serverless
Key Skills for This Role
Full Job Posting
What you’ll do
Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine
Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface
Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling
Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement
Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally
Lead the technical design, mentor other engineers and help define the engineering standards for a new product area
Requirements
- Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer or similar
- Experience building backend services, distributed systems, developer platforms or workload orchestration systems
- Strong understanding of async processing, queues, scheduling, retries, back pressure and failure handling
- Comfortable working across APIs, control planes, workers, databases and observability systems
- Strong engineering fundamentals in one or more backend languages ideally Go
- Good judgement around trade-offs between reliability, latency, scale, cost and developer experience
- Clear communication, strong ownership and the ability to lead technical direction in a fast-moving environment
Nice to have
- Experience building serverless platforms, job execution systems, container platforms or compute orchestration systems
- Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing or high-performance compute
- Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad or Knative
- Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing or queue management
- Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting or usage-based billing
Benefits
- We’re a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life.
- We move quickly and hold a high bar, but we also believe sustainable performance matters. After major releases and milestones, we create space for the team to properly unplug, recharge and come back with the energy to tackle what's next.
- Generous paid time off – vacation, sick days, public holidays
- Meaningful stock options – share in the upside you create
- Remote-first setup – work from home anywhere we can employ you
- Flexible hours – own your schedule outside core collaboration blocks
- Family leave – paid maternity, paternity, and caregiver time
- Company retreats – twice-yearly gatherings in inspiring locations
Responsibilities
- Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine
- Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface
- Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling
- Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement
- Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally
- Lead the technical design, mentor other engineers and help define the engineering standards for a new product area
About Runware
Generative AI API provider helping developers and businesses create image and visual media.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Runware
Senior Storage Engineer
, GBR
Network Architect
, GBR
Senior Security Engineer
, GBR
AI Factory Network Architect
, GBR
Network Architect
, USA
AI Factory Network Architect
, USA
Senior Storage Engineer
, USA
Senior Security Engineer
, USA