workday
INDStaff Software Engineer - AI
The Hartford
IND
Full-time
Senior · 8+ years experience
Discovered 4 days ago
awsazurebedrockdockergcpgithub-actions
Role Overview
We are seeking a highly skilled T7 AI Engineer to join our engineering team in Hyderabad, India.
This role combines hands-on AI/ML engineering with deep software development expertise to build, deploy, and operate production-grade AI systems at enterprise scale.
You will design and implement AI-powered solutions — from LLM integrations and agentic workflows to ML pipelines and intelligent automation — while driving AI adoption and engineering excellence across teams.
Key Skills for This Role
awsazurebedrockdockergcpgithub-actions
Full Job Posting
Key Responsibilities
- AI/ML Engineering & Delivery
- Design, build, and deploy production AI systems including RAG pipelines, agentic workflows, multi-model orchestration, and intelligent automation
- Integrate large language model (LLM) APIs and AI/ML services into enterprise applications (GCP Vertex AI)
- Implement and optimize prompt engineering strategies, fine-tuning pipelines, embeddings, and vector search solutions
- Build and maintain AI orchestration workflows using frameworks such as LangChain, Semantic Kernel, AutoGen, CrewAI, or LlamaIndex
- Develop custom AI agents, tools, and autonomous workflows that solve real business problems
- Establish evaluation frameworks for AI systems — measuring accuracy, latency, cost, hallucination rates, and business outcomes
- Full Stack Development & Integration
- Build end-to-end AI-powered applications spanning frontend, backend, APIs, and data layers
- Develop robust backend services using Python (FastAPI/Django) or Node.js to support AI workloads
- Implement and optimize RESTful APIs, GraphQL endpoints, and event-driven integrations for AI services
- Build modern frontend interfaces for AI-powered features using React, Angular, or Vue.js with TypeScript
- Write clean, well-tested, production-ready code with a focus on maintainability and operational excellence
- MLOps & AI Infrastructure
- Design and implement MLOps/LLMOps pipelines for reliable model deployment, versioning, and lifecycle management
- Configure and manage cloud-native AI infrastructure (AWS, GCP) including model serving, orchestration, and auto-scaling
- Implement observability for AI systems — monitoring model drift, token costs, latency, throughput, and quality metrics
- Build and maintain CI/CD pipelines for AI model deployment, automated testing, and continuous evaluation
- Design for resilience: failover strategies, fallback models, circuit breakers, and graceful degradation
- AI-Augmented Development
- Leverage AI coding assistants (GitHub Copilot, Cursor, Claude, etc.) to dramatically accelerate development workflows
- Use AI tools for code generation, refactoring, test writing, documentation, and code review
- Develop and maintain custom AI-powered developer tools, automations, and internal platforms
- Establish guardrails, security practices, and governance for responsible AI usage in engineering
- Technical Documentation & Mentorship
- Influence engineering culture by evangelizing AI-first development practices across teams
- Train and upskill team members on effective use of AI tools, LLM integration patterns, and ML best practices
- Contribute to internal knowledge bases, tech talks, and communities of practice
- Partner with product, design, and data science teams to identify and deliver AI-driven opportunities
- Participate in architecture reviews and design discussions, ensuring AI solutions are production-ready from day one
Required Qualifications
- Experience: 8+ years of professional software engineering experience, with 2+ years focused on AI/ML solution development and delivery
- Education: Bachelor's degree in Computer Science, Software Engineering, AI/ML, or related field (or equivalent experience)
- AI/ML Expertise:
- Strong understanding of large language model architectures, capabilities, and limitations
- Proven track record building and deploying production AI systems (RAG, agents, fine-tuning, embeddings, vector search)
- Proficiency with AI orchestration frameworks (LangChain, Semantic Kernel, AutoGen, CrewAI, LlamaIndex)
- Hands-on experience with major LLM providers and platforms (OpenAI, Anthropic, Google Vertex AI, AWS Bedrock)
- Solid understanding of prompt engineering, evaluation methodologies, and AI safety/guardrails
- Programming: Expert-level proficiency in Python; strong skills in at least one additional language (Java, TypeScript/Node.js, C#/.NET)
- Cloud & Infrastructure: Hands-on experience deploying and operating AI workloads on cloud platforms (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and CI/CD tooling (Jenkins, GitHub Actions)
- Data: Proficiency with SQL and NoSQL databases, vector databases (Pinecone, Weaviate, pgvector, ChromaDB), and data pipeline tools
- API Development: Proven track record building production APIs (REST, GraphQL, gRPC) and event-driven integrations
- AI Tools Proficiency: Advanced daily usage of AI coding assistants with demonstrated impact on productivity and code quality
- Testing: Strong testing practices for AI systems including model evaluation, integration testing, and automated quality checks
- Communication: Excellent written and verbal communication skills with ability to explain complex AI concepts to diverse audiences
- -
- 8+ years of professional software engineering experience, with 2+ years focused on AI/ML solution development and delivery
Preferred Qualifications
- Experience building enterprise AI platforms serving multiple product teams
- Familiarity with custom model training, fine-tuning (LoRA, QLoRA), and RLHF techniques
- Experience with agent-based AI architectures and autonomous multi-step workflows
- Knowledge of AI security concerns (prompt injection, data leakage, model poisoning) and mitigation strategies
- Experience in regulated industries (insurance, finance, healthcare) with security and compliance requirements
- Contributions to open-source AI/ML projects or published technical content
- Cloud certifications (AWS Solutions Architect, GCP Professional Cloud Architect, or equivalent)
- Experience with real-time inference, streaming responses, and low-latency AI serving architectures
- About Us | Our Culture | What It’s Like to Work Here
About The Hartford
Insurance19200 employeesFounded 1810
Provider of property and casualty insurance and employee benefits.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at The Hartford
VP AI Data Engineering, Business Insurance
Hartford, USA
Discovered TodayFull-time
Staff Engineer - Infrastructure
, IND
Discovered TodayFull-time
Sr. Accountant
Hartford, USA
Discovered YesterdayFull-time
Senior HR Analytics Consultant
Hartford, USA
Discovered YesterdayFull-time
Senior Trial Counsel
New York City, USA
Discovered YesterdayFull-time
Claims Team Leader Auto Litigation
Hartford, USA
Discovered YesterdayFull-time
Marine Claim Consultant
Red Bank, USA
Discovered YesterdayFull-time
INDStaff Software Engineer - AI
, IND
Discovered 4 days agoFull-time