Lead AI Data Engineer
About the Role
We are hiring Lead Agentic / Generative AI Engineers (9–12 years) to architect and deliver enterprise-grade LLM-powered and agentic systems at scale. This is a hands-on technical leadership role requiring: Deep expertise in LLMs, RAG, and agentic architectures Strong foundation in Data Engineering / Data Science Ability to lead solution design, mentor teams, and drive end-to-end delivery You will partner with cross-functional teams (Data Engineering, Data Science, MLOps, Product) to build secure, scalable, and measurable GenAI solutions, while also owning technical direction and best practices
Key Skills for This Role
Full Job Posting
Key Responsibilities
- Solution Architecture & Technical Leadership
- Architect enterprise-grade agentic and LLM solutions (single-agent, multi-agent, tool-driven workflows)
- Define scalable GenAI system design patterns (RAG, orchestration layers, evaluation frameworks)
- Act as the technical anchor for GenAI initiatives across projects
- Drive design reviews, architecture governance, and best practices
- Agentic AI & LLM Engineering
- Design and build agentic systems using LLMs for use cases such as:
- Knowledge assistants
- Document automation & intelligence
- Workflow orchestration
- Implement advanced prompt engineering strategies, prompt orchestration, and reasoning chains
- Build tool-calling / function-calling frameworks for agent workflows
- RAG & Retrieval Systems
- Lead end-to-end implementation of RAG pipelines:
- Data ingestion → chunking → embeddings → vector indexing → retrieval → response generation
- Optimise retrieval quality (recall, relevance, grounding)
- Evaluate and benchmark different architectures
- Productisation & Engineering Excellence
- Develop production-grade APIs/services (FastAPI, Flask, etc.)
- Drive code quality, testing standards, and reusable architecture components
- Ensure solutions are performance optimised (latency, cost, reliability)
- Governance, Safety & Evaluation
- Implement LLM guardrails:
- Hallucination control
- Safety filters
- Policy enforcement
- Define evaluation frameworks:
- Response quality metrics
- RAG benchmarking
- Human-in-the-loop validation
- Collaboration & Delivery Leadership
- Partner with:
- Data Engineering → pipelines, data quality, governance
- MLOps → deployment, CI/CD, monitoring
- Business/Product → use-case alignment
- Drive end-to-end delivery ownership across multiple projects
- Technical Leadership Responsibilities (Critical Addition)
- Mentor and guide junior engineers and project teams
- Conduct technical reviews, solution walkthroughs, and code reviews
- Support pre-sales / RFPs / solution proposals with architecture inputs
- Drive reusable accelerators, frameworks, and COE assets
- Stay ahead of industry evolution and help shape EXL’s GenAI strategy
- Influence technology choice, design decisions, and roadmap planning
- Must-Have Skills
Experience
- 9–12 years total experience
- 2–4+ years hands-on in LLM / GenAI delivery (production use cases)
- LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
- Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
- Data / AI Foundations (Mandatory)
- Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
- Analytics engineering / data products
- Leadership Capabilities
- Experience leading solution design or small teams
- Ability to translate business problems into AI solutions
- Strong stakeholder communication and influencing skills
- Good-to-Have / Preferred
- Fine-tuning approaches: LoRA / PEFT / prompt tuning
- Experience with Azure AI stack (Azure OpenAI, AI Search)
- Exposure to:
- Enterprise security & data privacy in GenAI
- Coding agents / autonomous agent frameworks
- Experience in insurance / BFSI domains (valuable for EXL use cases)
Preferred Qualifications
- Good-to-Have / Preferred
About EXL
EXL is a global data and AI company that provides analytics, digital operations, and industry-specific services to enterprises in insurance, healthcare, banking, retail, media, and energy.
Visit company websiteApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at EXL
Assistant Manager - Coding Auditor
Chennai, IND
Coding Assistant Manager is responsible for APC & Professional Surgery Audit review. This includes leveraging advanced medical coding analysis, enforcing policy adherence, and driving overpayment recovery programs. Creat
Manager
, IND
Professionals in this group are expected to create new algorithms from scratch. They work with large data sets and relational databases and have excellent problem-solving skills and the ability to analyze issues, identif
Manager - Quality Excellence
Kochi, IND
Manager – Quality Excellence (Kochi) to lead quality governance and process improvement for a US Healthcare Client. Lean Six Sigma GB/BB preferred.
Senior Executive
Noida, IND
The Claims assistant will be responsible for managing a high volume of claims, ensuring timely resolution, accurate documentation, and strong customer/carrier satisfaction. This role involves reviewing claim submissions,
Phone Auditor - Remote
, USA
Phone Auditor – Remote. Responsible for completing audits for Property & Casualty policies (Worker’s Compensation and General Liability) by phone with policyholders, ensuring accurate classifications and exposure amounts
Insurance Client Engagement Lead
Jersey City, USA
P&C Insurance Client Engagement Lead Pay Range: $150K -$190K US Remote
Assistant Manager - Coding Auditor
Chennai, IND
Senior Executive
Bengaluru, IND
Manager
, IND
Business Analyst
Gurugram, IND
Manager - Quality Excellence
Kochi, IND
Senior Executive
Noida, IND
Phone Auditor - Remote
, USA
Insurance Client Engagement Lead
Jersey City, USA