Principal AI Platform Engineer
Key Skills for This Role
Full Job Posting
Responsibilities
- Define and evolve the reference architecture for the AI control plane, paved-road services, SDKs, templates, and developer experience.
- Design and build a model gateway that supports multi-provider routing, failover, quota and rate limiting, tenant isolation, key management, token accounting, and cost allocation (e.g., a LiteLLM-style gateway over Azure OpenAI, Amazon Bedrock, or Vertex AI).
- Deliver a GenAI runtime for model serving, retrieval-augmented generation, context and memory stores, vector and hybrid search, sandboxed tool or code execution, secrets brokering, and MCP-style tool interoperability.
- Own the technical design of model, agent, prompt, and tool registries, including versioning, lineage, approval and promotion gates, deprecation, and auditability.
- Build platform observability and traceability for prompts, model calls, tool calls, and agent steps using distributed tracing (e.g., OpenTelemetry GenAI semantic conventions and Langfuse- or Arize-class tooling), with evaluation, quality, drift, latency, and cost signals.
- Implement security, guardrails, and responsible-AI controls in the platform, including PII/PHI handling, prompt-injection defenses, identity-on-behalf-of, least-privilege tool access, and policy enforcement.
- Establish platform engineering practices using Kubernetes, infrastructure as code, CI/CD, secure software development, capacity management, and reliability engineering. Define SLOs, participate in on-call, and lead incident response.
- Write and review production code, conduct architecture reviews, set engineering standards, and make pragmatic build-versus-buy and vendor recommendations with budget input.
- Hire, coach, and develop a platform engineering team of approximately 3–8 engineers; allocate work, set goals, and manage career development while remaining technically hands-on.
- Partner with the Product Manager, AI Platform to sequence the platform roadmap, communicate tradeoffs, and measure adoption, reliability, time-to-onboard, and consumer-team outcomes.
Requirements
- 10–15+ years of software engineering, platform engineering, distributed systems, or infrastructure experience, including significant technical leadership.
- Hands-on experience designing and operating enterprise AI/GenAI platforms or comparable developer, data, or ML platforms in production.
- Strong software engineering ability in Python and at least one of TypeScript, Go, or Java, with experience in APIs, distributed systems, testing, code review, and secure SDLC.
- Deep technical understanding of model gateways, GenAI runtimes, RAG, agent registries, evaluation, observability, traceability, guardrails, identity, and platform governance.
- Experience with containers and orchestration (e.g., Kubernetes), infrastructure as code, CI/CD, cloud services, secrets management, and production SLOs and on-call practices.
- Bachelor's degree in a related field or equivalent professional experience.
- Demonstrated ability to lead technical decisions, influence across teams, communicate clearly with senior stakeholders, and manage a growing engineering team.
- Experience building enterprise GenAI or agent platforms using capabilities such as multi-model routing, agent registries, prompt management, evaluation harnesses, and GenAI tracing.
- Experience in a highly regulated environment such as health tech, med-tech, or life sciences, with GxP, HIPAA, validation, auditability, and change-control constraints.
- Experience implementing security, responsible-AI, privacy, policy, and cost or FinOps controls for shared AI infrastructure.
- Experience with open standards and tooling such as MCP, OpenTelemetry, Kubernetes, and cloud-native platform engineering practices.
- The base pay for this position is
- $149,300.00 – $298,700.00
- In specific locations, the pay range may vary from the range posted.
- IT Services & Solutions Delivery
- BTS Business Technology Services
- United States > Abbott Park: AP06C
- Standard
- Yes, 10 % of the Time
- Continuous sitting for prolonged periods (more than 2 consecutive hours in an 8 hour day)
- Abbott is an Equal Opportunity Employer of Minorities/Women/Individuals with Disabilities/Protected Veterans.
- EEO is the Law link - English: http://webstorage.abbott.com/common/External/EEO_English.pdf
- EEO is the Law link - Espanol: http://webstorage.abbott.com/common/External/EEO_Spanish.pdf
Full Job Posting
Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 122,000 colleagues serve people in more than 160 countries. JOB DESCRIPTION: The Opportunity A hands-on technical leadership role accountable for the architecture, engineering, and reliability of Abbott's enterprise AI Platform: the control plane and paved road that let teams build, deploy, and operate enterprise GenAI and agentic systems safely and quickly. This role is the technical counterpart to the Product Manager, AI Platform and partners with AI Product Managers, AI/Agentic Engineering, Applied Data Science, security, and division engineering teams. The role is Director-mapped and begins as a player-coach, with responsibility to grow and lead a platform engineering team. What You'll Do
• Define and evolve the reference architecture for the AI control plane, paved-road services, SDKs, templates, and developer experience. • Design and build a model gateway that supports multi-provider routing, failover, quota and rate limiting, tenant isolation, key management, token accounting, and cost allocation (e.g., a LiteLLM-style gateway over Azure OpenAI, Amazon Bedrock, or Vertex AI). • Deliver a GenAI runtime for model serving, retrieval-augmented generation, context and memory stores, vector and hybrid search, sandboxed tool or code execution, secrets brokering, and MCP-style tool interoperability. • Own the technical design of model, agent, prompt, and tool registries, including versioning, lineage, approval and promotion gates, deprecation, and auditability. • Build platform observability and traceability for prompts, model calls, tool calls, and agent steps using distributed tracing (e.g., OpenTelemetry GenAI semantic conventions and Langfuse- or Arize-class tooling), with evaluation, quality, drift, latency, and cost signals. • Implement security, guardrails, and responsible-AI controls in the platform, including PII/PHI handling, prompt-injection defenses, identity-on-behalf-of, least-privilege tool access, and policy enforcement. • Establish platform engineering practices using Kubernetes, infrastructure as code, CI/CD, secure software development, capacity management, and reliability engineering. Define SLOs, participate in on-call, and lead incident response. • Write and review production code, conduct architecture reviews, set engineering standards, and make pragmatic build-versus-buy and vendor recommendations with budget input. • Hire, coach, and develop a platform engineering team of approximately 3–8 engineers; allocate work, set goals, and manage career development while remaining technically hands-on. • Partner with the Product Manager, AI Platform to sequence the platform roadmap, communicate tradeoffs, and measure adoption, reliability, time-to-onboard, and consumer-team outcomes.
Required Qualifications
• 10–15+ years of software engineering, platform engineering, distributed systems, or infrastructure experience, including significant technical leadership. • Hands-on experience designing and operating enterprise AI/GenAI platforms or comparable developer, data, or ML platforms in production. • Strong software engineering ability in Python and at least one of TypeScript, Go, or Java, with experience in APIs, distributed systems, testing, code review, and secure SDLC. • Deep technical understanding of model gateways, GenAI runtimes, RAG, agent registries, evaluation, observability, traceability, guardrails, identity, and platform governance. • Experience with containers and orchestration (e.g., Kubernetes), infrastructure as code, CI/CD, cloud services, secrets management, and production SLOs and on-call practices. • Bachelor's degree in a related field or equivalent professional experience. • Demonstrated ability to lead technical decisions, influence across teams, communicate clearly with senior stakeholders, and manage a growing engineering team.
Preferred Qualifications
• Experience building enterprise GenAI or agent platforms using capabilities such as multi-model routing, agent registries, prompt management, evaluation harnesses, and GenAI tracing. • Experience in a highly regulated environment such as health tech, med-tech, or life sciences, with GxP, HIPAA, validation, auditability, and change-control constraints. • Experience implementing security, responsible-AI, privacy, policy, and cost or FinOps controls for shared AI infrastructure. • Experience with open standards and tooling such as MCP, OpenTelemetry, Kubernetes, and cloud-native platform engineering practices.
The base pay for this position is $149,300.00 – $298,700.00 In specific locations, the pay range may vary from the range posted. JOB FAMILY: IT Services & Solutions Delivery DIVISION: BTS Business Technology Services LOCATION: United States > Abbott Park: AP06C ADDITIONAL LOCATIONS: WORK SHIFT: Standard TRAVEL: Yes, 10 % of the Time MEDICAL SURVEILLANCE: Not Applicable SIGNIFICANT WORK ACTIVITIES: Continuous sitting for prolonged periods (more than 2 consecutive hours in an 8 hour day) Abbott is an Equal Opportunity Employer of Minorities/Women/Individuals with Disabilities/Protected Veterans. EEO is the Law link - English: http://webstorage.abbott.com/common/External/EEO_English.pdf EEO is the Law link - Espanol: http://webstorage.abbott.com/common/External/EEO_Spanish.pdf
About Abbott
Global healthcare technology company focused on life-changing medical innovations.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Abbott
Ecommerce and Digital Marketing Manager
Dubai, UAE
Abbott Nutrition is seeking a Digital Marketing & E-Commerce Manager to lead digital marketing, e-commerce, and CRM strategy across UAE nutrition brands. The role drives customer engagement and online growth through camp
Ecommerce and Digital Marketing Manager
, UAE
Abbott Nutrition seeks a manager to lead digital marketing, e-commerce, and CRM strategy for nutrition brands in the UAE. The role drives online growth, campaigns, customer journeys, and commercial performance, requiring
Ecommerce and Digital Marketing Manager
Dubai, UAE
Procurement Manager
Irving, USA
Customer Service Specialist
Temecula, USA
Sales Manager, CPT - Fort Worth, TX
, USA
Production & Planner
, USA
Ecommerce and Digital Marketing Manager
, UAE
Ecommerce and Digital Marketing Manager
Dubai, UAE
TAVI GCC Therapy Leader
Riyadh, KSA