Software Engineer AI

Role overview

Duties and responsibilities

• Design LLM features and pipelines with LangChain or LangGraph; build and maintain RAG systems and optimize retrieval.
• Prototype and evaluate emerging AI capabilities, translating ambiguous problems into working demonstrations.
• Gather business needs with IT colleagues, product owners, and stakeholders and define scoped AI solutions.
• Support existing AI systems by troubleshooting pipeline, retrieval, prompt, and model-output issues.
• Contribute assigned work, participate in agile ceremonies, and support project goals.
• Track AI/ML developments and responsible AI practices; document workflows, integration patterns, prompts, and system architecture.
• At Principal level, lead technical design, mentor junior engineers, and promote best practices across teams.

Core competencies

• Python proficiency for AI/ML development and backend integration.
• Hands-on LangChain and/or LangGraph experience for agentic and multi-step LLM workflows.
• End-to-end RAG knowledge covering ingestion, chunking, embeddings, vector storage, and retrieval.
• Familiarity with leading LLM providers and APIs, including OpenAI, Anthropic, Azure OpenAI, or AWS Bedrock.
• AI evaluation and testing experience, including retrieval metrics, output assessment, and prompt regression testing.
• Understanding of AI observability and experimentation tools, plus vector databases and semantic search.
• Software engineering practices including Git, CI/CD, and Docker.
• Communication skills for explaining AI behavior and limitations to non-technical audiences.

Level-specific qualifications

• Senior level: qualifying education and experience pathways include an associate degree plus 4 years, bachelor's degree plus 2 years, master's degree plus 1 year, or at least 4 years of relevant Business/IT experience.
• Senior level also requires Python software delivery, REST API knowledge, LLM integration, RAG, prompt engineering, and agile project experience.
• Principal level: qualifying pathways include an associate degree plus 7 years, bachelor's degree plus 5 years, master's degree plus 3 years, or at least 7 years of relevant Business/IT experience.
• Principal level also requires technical design leadership, mentoring, and driving best practices across teams; 4 years of programming is preferred.
• Desired: agentic AI patterns, healthcare standards such as FHIR/HL7, structured outputs and function calling, AI-assisted development tools, user discovery, and responsible AI practices.

Work arrangement

• Position is based at the Ridgefield, Connecticut office, with three days on site.

Compensation

• Base salary is typically $75,000–$181,000; the position may also be eligible for a discretionary bonus, relocation, or other compensation elements.

Eligibility

• Candidates must be authorized to work in the United States without employer sponsorship, currently and in the future.
• The posting lists willingness to take a drug test and post-offer physical if required, and an age minimum of 18.