company_site
Senior LLMOps / AI Platform Engineer
IC Markets Global
Dubai, UAE
Full-time
Mid
Onsite
Discovered 2 days ago
awsdockerfastapigithub-actionshelmkubernetes
Role Overview
We are looking for a Senior LLMOps / AI Platform Engineer to build, deploy, optimize, and operate production-grade LLM and Generative AI infrastructure.
The role combines LLM inference, GPU optimization, Kubernetes, cloud infrastructure, observability, RAG, and AI platform engineering.
Key Skills for This Role
awsdockerfastapigithub-actionshelmkubernetes
Full Job Posting
Key Responsibilities
- Deploy and operate self-hosted LLMs using vLLM, SGLang, Ollama.
- Optimize LLM inference for latency, throughput, concurrency, GPU memory, KV cache, and cost.
- Manage GPU workloads across multiple NVIDIA GPUs.
- Deploy and maintain AI services on Kubernetes / AWS EKS using Docker and Helm.
- Implement LLM reliability mechanisms including health checks, monitoring, automated recovery, and model restart/refresh strategies.
- Implement observability using Langfuse/LangSmith, OpenTelemetry, Prometheus, and Grafana.
- Deploy and optimize RAG systems, embedding models, and vector databases such as Qdrant, Milvus.
- Support AI agents and workflows built with LangChain and LangGraph.
- Build and maintain CI/CD pipelines for AI services and infrastructure.
- Troubleshoot production issues across LLMs, GPUs, Kubernetes, networking, and AI applications.
Required Skills
- Strong Python and FastAPI experience
- vLLM, Hugging Face and self-hosted LLM deployment
- Kubernetes, Docker, Helm and AWS
- NVIDIA GPU inference and performance optimization
- LangChain / LangGraph/LangSmith
- RAG, embeddings and vector databases (Qdrant)
- LLM observability and monitoring
- PostgreSQL / Redis
- GitHub Actions / CI/CD
- Strong production troubleshooting skills
Qualifications
- Strong Python and FastAPI experience
- vLLM, Hugging Face and self-hosted LLM deployment
- Kubernetes, Docker, Helm and AWS
- NVIDIA GPU inference and performance optimization
- LangChain / LangGraph/LangSmith
- RAG, embeddings and vector databases (Qdrant)
- LLM observability and monitoring
- PostgreSQL / Redis
- GitHub Actions / CI/CD
- Strong production troubleshooting skills
About IC Markets Global
Banking1127 employeesFounded 2007
IC Markets is a private regulated forex and CFD broker serving retail and institutional traders worldwide.
Visit company websiteApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at IC Markets Global
Senior Security Cloud Engineer
Hyderabad, IND
Discovered 2 days agoFull-time
Salesforce business Analyst
Dubai, UAE
Discovered 2 days agoFull-time
.NET Engineer - Integration
Hyderabad, IND
Discovered 2 days agoFull-time
Technical Delivery Manager
Hyderabad, IND
Discovered 2 days agoFull-time
Accountant
Hyderabad, IND
Discovered 2 days agoFull-time
Emerging Talent Program - UAE National
Dubai, UAE
Discovered 2 days agoFull-time
Junior Marketing Data Analyst
Dubai, UAE
Discovered 2 days agoFull-time
Senior Accountant
Dubai, UAE
Discovered 2 days agoFull-time