Digital Agent Developer
Full Job Posting
WHAT YOU’LL DO
Design, configure, and optimize conversational AI agents within Sierra Agent OS.
Build reusable reference models and design patterns for multiple business use cases.
Develop and refine agent experiences across voice, chat, and email channels.
Analyze conversation data and performance metrics to improve accuracy, containment, and customer outcomes.
Create and optimize prompts, workflows, decision logic, and handoff experiences.
Collaborate with platform engineers and solution architects on multi-LLM orchestration strategies.
Support testing, deployment, monitoring, and continuous improvement of AI agent solutions.
Run agent simulations and regression tests before each release, and review production conversations where the agent fell short to find the cause and fix it.
Work with the integration and platform teams on the APIs and tools the agents call (account lookup, order status, case creation, appointment scheduling) and on how the agent should behave when those calls fail.
Maintain agent documentation, test cases, and the support runbooks that the service desk and L3 support teams rely on.
Follow enterprise security, compliance, documentation, and governance standards.
BASIC REQUIREMENTS
2+ years of experience building AI agents or conversational AI solutions (LLM-based assistants, chatbots, voicebots), or in AI/ML or software development with hands-on agent work.
Bachelor's degree in Computer Science, Engineering, Information Technology, Data Science, or equivalent experience.
Hands-on experience designing, building, or tuning LLM-based AI agents or digital assistants, including prompts, tool and function calling, workflows, guardrails, and handoff to a human agent.
Hands-on experience with prompt engineering, conversational design, intent modeling, or Natural Language Understanding (NLU).
Working knowledge of agentic AI patterns: multi-step tool use, retrieval (RAG), evaluation and testing of agents, and the ways an agent can fail in production. This can come from any agent platform; Sierra experience is a plus, not a requirement.
Experience analyzing data and leveraging insights to improve AI performance and user outcomes.
Knowledge of APIs, JSON, and modern software development practices, including the ability to read API responses, logs, and conversation transcripts to work out why an agent behaved the way it did.
Familiarity with CI/CD pipelines, version control systems, and testing methodologies.
Strong problem-solving, communication, and cross-functional collaboration skills.
PREFERRED SKILLS/EXPERIENCE
Experience with multi-agent systems, agent frameworks or SDKs (e.g., LangGraph, OpenAI Agents SDK, Bedrock Agents, Vertex Agent Builder), or MCP-based tool integration.
Hands-on experience with Sierra Agent OS (a new platform; we will train the right candidate), or with other agent platforms such as Salesforce Agentforce, Google CCAI/Dialogflow, Amazon Lex/Connect, Kore.ai, or Microsoft Copilot Studio.
Hands-on experience with voice AI, chatbots, virtual assistants, or customer-service automation solutions.
Knowledge of multi-LLM routing, orchestration, retrieval-augmented generation (RAG), or AI evaluation frameworks.
Experience in healthcare, regulated industries, or enterprise-scale environments.
Exposure to analytics and monitoring tools used to evaluate conversational AI performance.
Experience with simulation-based or automated testing of conversational agents (e.g., Tosca or custom test harnesses).
Familiarity with the systems a contact center agent typically integrates with: Five9 or another CCaaS platform, Salesforce Service Cloud, SAP, or MuleSoft APIs.
Experience collaborating with product, architecture, platform engineering, and business teams.
Familiarity with cloud-native application development and integration patterns.
TRAVEL / WORK LOCATION / PHYSICAL REQUIREMENTS
Minimal travel, based on business needs.
Hybrid or remote work arrangements subject to business and team requirements.
Ability to work at a computer and participate in virtual and in-person meetings for extended periods.
We are proud to offer a competitive compensation package at McKesson as part of our Total Rewards. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets. The pay range shown below is aligned with McKesson's pay philosophy, and pay will always be compliant with any applicable regulations. In addition to base pay, other compensation, such as an annual bonus or long-term incentive opportunities may be offered. For more information regarding benefits at McKesson, please click here.
Our Base Pay Range for this position
$81,500 - $108,600
McKesson has become aware of online recruiting-related scams in which individuals who are not affiliated with or authorized by McKesson are using McKesson’s (or affiliated entities, like CoverMyMeds or RxCrossroads) name in fraudulent emails, job postings or social media messages. In light of these scams, please bear the following in mind: McKesson Talent Advisors will never solicit money or credit card information in connection with a McKesson job application.
McKesson Talent Advisors do not communicate with candidates via online chatrooms or using email accounts such as Gmail or Hotmail. Note that McKesson does rely on a virtual assistant (Gia) for certain recruiting-related communications with candidates.
McKesson job postings are posted on our career site: careers.mckesson.com.
McKesson is an Equal Opportunity Employer
McKesson provides equal employment opportunities to applicants and employees, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age, genetic information, or any other legally protected category. For additional information on McKesson’s full Equal Employment Opportunity policies, visit our Equal Employment Opportunity page.
McKesson is committed to being an Equal Employment Opportunity Employer and offers opportunities to all job seekers including job seekers with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to (United States) [email protected] or (Canada) [email protected]. Resumes or CVs submitted to this email box will not be accepted.
Join us at McKesson!
Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Technology, Data Science, or equivalent experience.
- Hands-on experience with prompt engineering, conversational design, intent modeling, or Natural Language Understanding (NLU).
- Familiarity with CI/CD pipelines, version control systems, and testing methodologies.
- Experience with multi-agent systems, agent frameworks or SDKs (e.g., LangGraph, OpenAI Agents SDK, Bedrock Agents, Vertex Agent Builder), or MCP-based tool integration.
- Hands-on experience with Sierra Agent OS (a new platform; we will train the right candidate), or with other agent platforms such as Salesforce Agentforce, Google CCAI/Dialogflow, Amazon Lex/Connect, Kore.ai, or Microsoft Copilot Studio.
- Hands-on experience with voice AI, chatbots, virtual assistants, or customer-service automation solutions.
- Experience with simulation-based or automated testing of conversational agents (e.g., Tosca or custom test harnesses).
- Familiarity with the systems a contact center agent typically integrates with: Five9 or another CCaaS platform, Salesforce Service Cloud, SAP, or MuleSoft APIs.
- Familiarity with cloud-native application development and integration patterns.
Responsibilities
- Design, configure, and optimize conversational AI agents within Sierra Agent OS.
- Build reusable reference models and design patterns for multiple business use cases.
- Develop and refine agent experiences across voice, chat, and email channels.
- Analyze conversation data and performance metrics to improve accuracy, containment, and customer outcomes.
- Create and optimize prompts, workflows, decision logic, and handoff experiences.
- Collaborate with platform engineers and solution architects on multi-LLM orchestration strategies.
- Support testing, deployment, monitoring, and continuous improvement of AI agent solutions.
- Run agent simulations and regression tests before each release, and review production conversations where the agent fell short to find the cause and fix it.
- Work with the integration and platform teams on the APIs and tools the agents call (account lookup, order status, case creation, appointment scheduling) and on how the agent should behave when those calls fail.
- Maintain agent documentation, test cases, and the support runbooks that the service desk and L3 support teams rely on.
- Follow enterprise security, compliance, documentation, and governance standards.
- 2+ years of experience building AI agents or conversational AI solutions (LLM-based assistants, chatbots, voicebots), or in AI/ML or software development with hands-on agent work.
- Bachelor's degree in Computer Science, Engineering, Information Technology, Data Science, or equivalent experience.
- Hands-on experience designing, building, or tuning LLM-based AI agents or digital assistants, including prompts, tool and function calling, workflows, guardrails, and handoff to a human agent.
- Hands-on experience with prompt engineering, conversational design, intent modeling, or Natural Language Understanding (NLU).
- Working knowledge of agentic AI patterns: multi-step tool use, retrieval (RAG), evaluation and testing of agents, and the ways an agent can fail in production. This can come from any agent platform; Sierra experience is a plus, not a requirement.
- Experience analyzing data and leveraging insights to improve AI performance and user outcomes.
- Knowledge of APIs, JSON, and modern software development practices, including the ability to read API responses, logs, and conversation transcripts to work out why an agent behaved the way it did.
- Familiarity with CI/CD pipelines, version control systems, and testing methodologies.
- Strong problem-solving, communication, and cross-functional collaboration skills.
- Experience with multi-agent systems, agent frameworks or SDKs (e.g., LangGraph, OpenAI Agents SDK, Bedrock Agents, Vertex Agent Builder), or MCP-based tool integration.
- Hands-on experience with Sierra Agent OS (a new platform; we will train the right candidate), or with other agent platforms such as Salesforce Agentforce, Google CCAI/Dialogflow, Amazon Lex/Connect, Kore.ai, or Microsoft Copilot Studio.
- Hands-on experience with voice AI, chatbots, virtual assistants, or customer-service automation solutions.
- Knowledge of multi-LLM routing, orchestration, retrieval-augmented generation (RAG), or AI evaluation frameworks.
- Experience in healthcare, regulated industries, or enterprise-scale environments.
- Exposure to analytics and monitoring tools used to evaluate conversational AI performance.
- Experience with simulation-based or automated testing of conversational agents (e.g., Tosca or custom test harnesses).
- Familiarity with the systems a contact center agent typically integrates with: Five9 or another CCaaS platform, Salesforce Service Cloud, SAP, or MuleSoft APIs.
- Experience collaborating with product, architecture, platform engineering, and business teams.
- Familiarity with cloud-native application development and integration patterns.
- Minimal travel, based on business needs.
- Hybrid or remote work arrangements subject to business and team requirements.
- Ability to work at a computer and participate in virtual and in-person meetings for extended periods.
- We are proud to offer a competitive compensation package at McKesson as part of our Total Rewards. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets. The pay range shown below is aligned with McKesson's pay philosophy, and pay will always be compliant with any applicable regulations. In addition to base pay, other compensation, such as an annual bonus or long-term incentive opportunities may be offered. For more information regarding benefits at McKesson, please click here.
- Our Base Pay Range for this position
- $81,500 - $108,600
- McKesson has become aware of online recruiting-related scams in which individuals who are not affiliated with or authorized by McKesson are using McKesson’s (or affiliated entities, like CoverMyMeds or RxCrossroads) name in fraudulent emails, job postings or social media messages. In light of these scams, please bear the following in mind:
- McKesson Talent Advisors will never solicit money or credit card information in connection with a McKesson job application.
- McKesson Talent Advisors do not communicate with candidates via online chatrooms or using email accounts such as Gmail or Hotmail. Note that McKesson does rely on a virtual assistant (Gia) for certain recruiting-related communications with candidates.
- McKesson job postings are posted on our career site: careers.mckesson.com.
- McKesson is an Equal Opportunity Employer
- McKesson provides equal employment opportunities to applicants and employees, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age, genetic information, or any other legally protected category. For additional information on McKesson’s full Equal Employment Opportunity policies, visit our Equal Employment Opportunity page.
- McKesson is committed to being an Equal Employment Opportunity Employer and offers opportunities to all job seekers including job seekers with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to (United States) [email protected] or (Canada) [email protected]. Resumes or CVs submitted to this email box will not be accepted.
- Join us at McKesson!
About McKesson
Diversified healthcare services and supply chain leader.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at McKesson
Business Process Analyst
, USA
McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here
Senior Analyst, Business Intelligence (12 month Contract)
Mississauga, CAN
McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here
Sr. Analyst, Visualization (RAIB)
Mississauga, CAN
McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here
Analyste principal(e) en intelligence d’affaires/ Senior Analyst, Business Intelligence (contrat 12 mois)
, CAN
McKesson is seeking a senior business intelligence analyst to build interactive reports, dashboards, and data models for its pharmaceutical distribution business. The role requires at least three years of relevant experi
Business Process Analyst
, USA
Senior Analyst, Business Intelligence (12 month Contract)
Mississauga, CAN
Sr. Analyst, Visualization (RAIB)
Mississauga, CAN
Analyste principal(e) en intelligence d’affaires/ Senior Analyst, Business Intelligence (contrat 12 mois)
, CAN
Warehouse Worker - Full Time Shift
, USA
Material Handler - Full Time Shifts
, USA
Material Handler - Full Time Shift
, USA
Associate Biomed Technician
, USA