AI Engineer 3

Role and team

What you'll do

• Partner across engineering, research, program management, and product to deliver AI-powered products.
• Design, develop, test, deploy, and support AI components spanning foundation models, LLM inference, agents, similarity search, guardrails, evaluation, governance, and observability.
• Use open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
• Optimize production foundation models for scalability, cost, latency, and throughput, and contribute to the technical vision and roadmap.
• Lead development and benchmarking of multi-turn conversational and tool-using agents with measurable performance and safety metrics.
• Build scalable pipelines to train, fine-tune, and deploy foundation or domain-specific models across environments.
• Collaborate on dataset curation and model evaluation; support model traceability, lineage, security, and version control.
• Mentor junior engineers and promote engineering excellence, reproducibility, and responsible experimentation.

Basic qualifications

• Relevant bachelor's degree plus at least 3 years developing AI/ML algorithms or technologies, or relevant master's degree plus at least 1 year of that experience.
• At least 3 years programming with Python, Go, Scala, CUDA, or Java.

Preferred qualifications

• Experience making AI-system tradeoffs across cost, latency, throughput, and accuracy; 4 or more years deploying scalable, responsible AI on cloud platforms is preferred.
• Experience developing and supporting AI services or algorithms; optimizing training and inference; and building agentic AI systems is preferred.
• Experience evaluating LLMs quantitatively and implementing RAG, vector database integrations, fine-tuning, prompt engineering, safety guardrails, or red-teaming is preferred.

Compensation

• The posting gives full-time annual salary ranges by location: $161,800–$184,600 in Cambridge and McLean; $176,500–$201,400 in New York, San Francisco, and San Jose.
• The role may also earn performance-based incentives, including cash bonuses or long-term incentives.

Benefits

• Capital One describes a competitive benefits package supporting health and financial well-being; eligibility varies by work status and management level.