GPU / AI Inference Engineer
Role Overview
Deploy, optimize, and manage GPU-based AI model-serving and inference infrastructure.
Key Skills for This Role
Full Job Posting
Job summary
Deploy, optimize, and manage GPU-based AI model-serving and inference infrastructure.
Key responsibilities
- Configure NVIDIA GPU Operator, drivers, and GPU monitoring.
- Deploy and optimize vLLM, LMCache, KServe, LiteLLM, and TEI/Infinity.
- Manage AI model deployment, autoscaling, batching, and GPU scheduling.
- Optimize inference performance, latency, throughput, and GPU memory utilization.
- Implement GPU observability, workload orchestration, and cost tracking.
Required skills
- Strong NVIDIA GPU, Linux, and Kubernetes experience.
- Expertise in vLLM or a similar AI inference framework.
- Knowledge of GPU scheduling, model serving, and performance optimization.
- Familiarity with LLM gateways, embeddings, rerankers, and Kueue.
Work location
- Work location is in person.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Spectrum Solution W.L L
Business Development Manager – Staff Augmentation
, QAT
The employer is seeking a business development manager to grow staff augmentation and workforce solutions sales in Qatar. The role covers client acquisition, full-cycle sales, tenders, and account growth; applicants need
Executive Coordinator & Office Management
, QAT
The employer seeks an Executive Coordinator to support senior management through calendar, meeting, correspondence, and action tracking coordination. Candidates need 3–5 years of relevant experience, fluent Arabic and En
Senior SharePoint & Full-Stack Developer (React / .NET)
, QAT
The employer is seeking a senior developer to build and maintain enterprise SharePoint solutions and full-stack applications. The role requires SharePoint, React, and .NET experience, with a bachelor's degree in a relate
Senior Kubernetes / Infrastructure Engineer
, QAT
The employer is seeking a senior engineer to deploy and maintain secure, scalable bare-metal Kubernetes platforms. The role requires strong Linux and Kubernetes administration experience, including RKE2, Cilium, Ceph, An
DevSecOps / Supply Chain Engineer
, QAT
The employer is seeking a DevSecOps Engineer to secure CI/CD pipelines, identity management, Kubernetes, and software supply chains. Candidates need hands-on skills with Kubernetes security, GitLab CI/CD, Argo CD, identi
E-Commerce Specialist – Digital Payments
, QAT
The employer seeks an experienced E-Commerce Specialist to support online payment operations and gateway integrations. Candidates need experience in e-commerce, digital payments, or fintech, hands-on CyberSource or MPGS
UX/UI Engineer
, QAT
The employer is seeking a UX/UI Engineer to design and develop responsive, user-friendly web applications. Candidates need at least 3 years of UI development experience, a relevant bachelor's degree, and proficiency in H
Call Centre Representative (Arabic / English)
, QAT
Spectrum Solutions seeks customer-focused Call Centre Representatives with mandatory customer service and call-center experience. The role requires fluent spoken and written Arabic and English, a valid Qatar ID, strong c
Business Development Manager – Staff Augmentation
, QAT
Executive Coordinator & Office Management
, QAT
Senior SharePoint & Full-Stack Developer (React / .NET)
, QAT
Senior Kubernetes / Infrastructure Engineer
, QAT
DevSecOps / Supply Chain Engineer
, QAT
E-Commerce Specialist – Digital Payments
, QAT
UX/UI Engineer
, QAT
Call Centre Representative (Arabic / English)
, QAT