workable
Senior Software Engineer (vLLM)
CommonAI
Cambridge, GBR
Full-time
Senior
Onsite
Discovered 2 weeks ago
pythonpytorchrust
Key Skills for This Role
pythonpytorchrust
Full Job Posting
Requirements
- Proven experience working as a Senior Software Engineer with deep expertise in both Python and low-level programming (e.g. C/C++, Rust, assembly or CUDA).
- A history of direct contributions to vLLM or similar high-performance open-source ML/AI projects (e.g. PyTorch, Hugging Face TGI, TensorRT-LLM, Ray).
- Strong understanding of LLM inference mechanics (e.g. KV caching, continuous batching, memory management, model quantisation).
- Experience interacting with, and upstreaming code to, active open-source communities.
- Hands-on experience working on performance optimisation for hardware accelerators (GPUs, TPUs, CPU vector units or other accelerators).
- A strong enthusiasm for using LLMs, coding assistants, and agents as core tools in your own software development process.
- We also value:
- Experience working on software systems that operate in highly regulated or high-assurance environments (e.g. financial services).
- An understanding of the latest AI safety research and active involvement in that community.
- Deep knowledge of modern MLOps practices, CI/CD, and large-scale deployments.
Benefits
- A collaborative and supportive work environment
- The opportunity to have a high impact in a growing organisation
- Competitive salary package and pension
- Professional development opportunities
- Networking opportunities with influential people from across the tech sector, financial services, and academia
- A vibrant office environment located a few minutes' walk away from Cambridge train station
- CommonAI CIC is an equal opportunity employer and is committed to creating an inclusive and diverse workplace.
Responsibilities
- Deploy, instrument and monitor open weight models served using vLLM.
- Implement new features within vLLM to support novel hardware architectures as part of the Scaling Inference Lab.
- Work with the Panopticon team to identify opportunities to extend vLLM to enhance accuracy, explainability, and accountability when using it to serve models in regulated environments.
- Actively collaborate with the open-source vLLM community to propose, review, and upstream core changes.
- Troubleshoot, profile, and optimise inference performance, focusing on latency, throughput, and hardware utilisation.
About CommonAI
IT Services & Consulting16 employeesFounded 2024
CommonAI is a UK-based nonprofit organization focused on artificial intelligence and technology.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at CommonAI
Systems Performance Engineer, AI Infrastructure
Cambridge, GBR
MidFull-time
Discovered 2 weeks agoView →
Technical Analyst, AI Infrastructure and Investment
Cambridge, GBR
MidFull-time
Discovered 2 weeks agoView →
Systems Software Engineer, Cluster Control and Automation
Cambridge, GBR
MidFull-time
Discovered 2 weeks agoView →
GPU Kernel and Performance Engineer
Cambridge, GBR
Discovered 1 weeks agoFull-time
Research Scientist (LLM Architectures)
Cambridge, GBR
Discovered 1 weeks agoFull-time
Network Infrastructure Engineer
Cambridge, GBR
Discovered 2 weeks agoFull-time
Technical Lead, AI Systems Simulation
Cambridge, GBR
Discovered 2 weeks agoFull-time
Systems Performance Engineer, AI Infrastructure
Cambridge, GBR
Discovered 2 weeks agoFull-time
Technical Analyst, AI Infrastructure and Investment
Cambridge, GBR
Discovered 2 weeks agoFull-time
Systems Software Engineer, Cluster Control and Automation
Cambridge, GBR
Discovered 2 weeks agoFull-time
