Staff Inference Engineer

Qualifications

• Required:
• 5+ years engineering, including 3+ years hands-on with GPU systems, distributed inference, or ML serving
• Production experience with vLLM, SGLang, or TensorRT-LLM
• Strong Python and C++ (C++17/20); ability to read and debug CUDA C++ or HIP kernels
• Hands-on GPU profiling and performance optimization
• Preferred:
• Custom GPU kernel development (CUDA, HIP, Triton, CUTLASS)
• PyTorch internals — torch. Compile, custom operators, MoE or disaggregated
• prefill/decode
• LoRA/SLM adapter serving and zero-downtime hot swapping
• NVIDIA and AMD Instinct hardware in production
• Telemetry with DCGM, AMD SMI, Prometheus, and Grafana
• Comp range/OTE: 190- 240K USD
• Hiring Pay Range:
• $200,000 - $350,000