{bc}
Apply
oracle

Senior Software Engineer - AI Gateway & Agentic AI Solutions

exl Service.com (India) Private Limited
Gurugram, IND
Senior
Hybrid
Discovered 4 weeks ago
azurecsharpopenaiopentelemetry

Full Job Posting

Qualifications

  • Top 5 Required Skills / Background
  • Deep C#/.NET engineering background (12-15+ years). Production-grade API/service development, async patterns, dependency injection, testing discipline, and comfort operating without a large surrounding platform team.
  • Hands-on Azure platform expertise. Azure API Management (including GenAI/LLM-specific policies: token-limit, token-metric, semantic-caching), Azure OpenAI / Azure AI Foundry, Azure Monitor / Application Insights, Key Vault, and either Azure Functions/App Service or AKS for hosting gateway services.
  • Working knowledge of LLM gateway and observability platforms. Familiarity with LiteLLM, Langfuse, or comparable tools (Portkey, Kong AI Gateway) - not to operate them directly, but to translate their proven patterns (routing, fallback, semantic caching, token metering, tracing) into an Azure/C# implementation.
  • Microsoft Agent Framework experience, or a direct path into it. Hands-on work with MAF, or strong prior experience in Semantic Kernel and/or AutoGen (MAF's predecessors) - multi-agent orchestration, tool/function calling, thread/state management, and ideally MCP/A2A protocol exposure.
  • Client-facing solution engineering track record. Demonstrated ability to architect, prototype, and present technical PoCs directly to enterprise client stakeholders, defend design trade-offs live, and adapt scope under engagement time pressure.

Responsibilities

  • Deep C#/.NET engineering background (12-15+ years). Production-grade API/service development, async patterns, dependency injection, testing discipline, and comfort operating without a large surrounding platform team.
  • Hands-on Azure platform expertise. Azure API Management (including GenAI/LLM-specific policies: token-limit, token-metric, semantic-caching), Azure OpenAI / Azure AI Foundry, Azure Monitor / Application Insights, Key Vault, and either Azure Functions/App Service or AKS for hosting gateway services.
  • Working knowledge of LLM gateway and observability platforms. Familiarity with LiteLLM, Langfuse, or comparable tools (Portkey, Kong AI Gateway) - not to operate them directly, but to translate their proven patterns (routing, fallback, semantic caching, token metering, tracing) into an Azure/C# implementation.
  • Microsoft Agent Framework experience, or a direct path into it. Hands-on work with MAF, or strong prior experience in Semantic Kernel and/or AutoGen (MAF's predecessors) - multi-agent orchestration, tool/function calling, thread/state management, and ideally MCP/A2A protocol exposure.
  • Client-facing solution engineering track record. Demonstrated ability to architect, prototype, and present technical PoCs directly to enterprise client stakeholders, defend design trade-offs live, and adapt scope under engagement time pressure.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at exl Service.com (India) Private Limited

Manager

, IND

Discovered TodayFull-time

Senior Executive - Coding Auditor

Chennai, IND

Discovered TodayFull-time

Senior Architect - Solutioning-Application Development-Applications Development Engineering

Noida, IND

Discovered TodayFull-time

Business Analyst

Gurugram, IND

Discovered TodayFull-time

Assistant Manager

Gurugram, IND

Discovered TodayFull-time

Manager

Gurugram, IND

Discovered TodayFull-time

Assistant Manager

Pune, IND

Discovered TodayFull-time

Senior Associate

Bengaluru, IND

Discovered TodayFull-time