Architect AI Data Engineer
About the Role
We are looking for experienced Agentic / Generative AI Architects with 12–15 years of experience to lead the design, architecture, and enterprise-scale deployment of LLM-powered and agentic systems. This role goes beyond implementation—owning solution architecture, platform strategy, governance, and engineering excellence for GenAI initiatives across business domains. You will work closely with data engineering, data science, MLOps, product, and business stakeholders to deliver secure, scalable, cost-efficient, and production-grade GenAI platforms and solutions. Mandatory: Strong background in Data Engineering or Data Science (pipelines, ML lifecycle, data platforms, or analytics engineering).
Key Skills for This Role
Full Job Posting
Key Responsibilities
- Solution Architecture & Strategy
- Define and lead end-to-end architecture for enterprise GenAI platforms and use cases
- Design scalable agentic systems (single-agent, multi-agent, orchestration frameworks)
- Establish reference architectures, design patterns, and reusable frameworks
- Lead architecture decisions on RAG vs fine-tuning vs hybrid approaches
- Conduct technology evaluations (LLMs, vector DBs, orchestration frameworks) and recommend best-fit solutions
- Agentic AI & LLM Engineering Leadership
- Design and implement complex agentic workflows with tool calling, function orchestration, and memory strategies
- Build enterprise-grade RAG pipelines with strong focus on retrieval accuracy and evaluation
- Drive prompt architecture standards (prompt libraries, chaining, orchestration governance)
- Optimise solutions for latency, cost, scalability, and reliability
- Platform & Engineering Excellence
- Lead development of GenAI platforms, APIs, and microservices (FastAPI, Flask, etc.)
- Define engineering best practices: coding standards, testing, packaging, observability
- Ensure seamless integration with enterprise data platforms, APIs, and business applications
- Collaborate with MLOps teams for CI/CD, deployment pipelines, versioning, and monitoring
- Governance, Risk & Responsible AI
- Define and enforce LLM guardrails (hallucination control, safety filters, policy enforcement)
- Implement evaluation frameworks (RAG evaluation, prompt testing, benchmarking)
- Ensure compliance with data security, privacy, and enterprise governance standards
- Drive adoption of Responsible AI practices (bias mitigation, explainability, auditability)
- Data & Ecosystem Collaboration
- Partner with Data Engineering teams on:
- Data ingestion, pipelines, and quality controls
- Metadata management and knowledge graph strategies
- Work with business stakeholders to:
- Identify high-value GenAI use cases
- Translate business problems into AI-driven solutions
- Leadership & Stakeholder Management
- Provide technical leadership and mentorship to engineering teams
- Act as a solution advisor to clients/stakeholders (including pre-sales, PoCs, solutioning)
- Present architecture and design decisions to senior leadership and CXOs
- Drive COE initiatives, knowledge sharing, and internal capability building
- Must-Have Skills & Experience
Experience
- 12–15 years total experience, with 3+ years in GenAI / LLM-based systems
- Proven experience in leading architecture and delivery of enterprise solutions
- LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
- Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
- Cloud & Platform
- Hands-on experience with Azure / AWS / GCP
- Familiarity with:
- Containers (Docker/Kubernetes)
- CI/CD pipelines
- Monitoring & observability
- Data / AI Foundations (Mandatory)
- Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
- Analytics engineering / data products
- Good-to-Have / Preferred
- Fine-tuning techniques ( LoRA, PEFT, prompt tuning )
- Experience with Azure AI stack (Azure OpenAI, Cognitive Search)
- Knowledge of knowledge graphs, semantic layers, or enterprise search
- Experience in domain-specific GenAI solutions (Insurance, BFSI, Healthcare)
Preferred Qualifications
- Good-to-Have / Preferred
About EXL
EXL is a global data and AI company that provides analytics, digital operations, and industry-specific services to enterprises in insurance, healthcare, banking, retail, media, and energy.
Visit company websiteApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at EXL
Data Scientist- GenAI Engineer
Noida, IND
We are seeking an experienced Data Scientist with deep expertise in Generative AI and Python to design, develop, and deploy advanced AI models that drive innovation and deliver impactful solutions. This role involves wor
Senior Executive - Claims Audit
Chennai, IND
Senior Executive- Claims Analyst is responsible for reviewing and analyzing medical records and claims to ensure accuracy, completeness, and compliance with regulatory standards. This role involves summarizing medical do
Associate - Business Analyst
Noida, IND
Identify F&A automation opportunities in client environment and able to perform end to end automation operations Core Alteryx + Power BI and Tableau developer with at least 4 years of experience in creating dynamic wor
Executive
Pune, IND
This role is primarily responsible for dealing with customer calls as per the SLAs outlined by the client
Senior Executive
Bengaluru, IND
Generate and process customer invoices in accordance with contractual terms and billing schedules. Review billing inputs for completeness, accuracy, and compliance with client requirements. Submit invoices through custom
Alteryx Developer
Noida, IND
Role • Band B1/B2 level resources for EXL Digital Analytics team to be based out of Noida (SEZ), Gurgaon, Bangalore, Pune • Supports Analytics solutions team in ramping up F&A analytics and reporting practice • Front-end
Data Scientist- GenAI Engineer
Noida, IND
Senior Executive - Claims Audit
Chennai, IND
Associate - Business Analyst
Noida, IND
Executive
Pune, IND
Senior Executive
Bengaluru, IND
Senior Executive
Bengaluru, IND
Senior Associate
Bengaluru, IND
Alteryx Developer
Noida, IND