{bc}
workday

Digital Agent Developer

McKesson
Ontario, CAN
Full-time
Junior · 2+ years experience
Hybrid
Discovered 1 weeks ago

Full Job Posting

WHAT YOU’LL DO

Design, configure, and optimize conversational AI agents within Sierra Agent OS.

Build reusable reference models and design patterns for multiple business use cases.

Develop and refine agent experiences across voice, chat, and email channels.

Analyze conversation data and performance metrics to improve accuracy, containment, and customer outcomes.

Create and optimize prompts, workflows, decision logic, and handoff experiences.

Collaborate with platform engineers and solution architects on multi-LLM orchestration strategies.

Support testing, deployment, monitoring, and continuous improvement of AI agent solutions.

Run agent simulations and regression tests before each release, and review production conversations where the agent fell short to find the cause and fix it.

Work with the integration and platform teams on the APIs and tools the agents call (account lookup, order status, case creation, appointment scheduling) and on how the agent should behave when those calls fail.

Maintain agent documentation, test cases, and the support runbooks that the service desk and L3 support teams rely on.

Follow enterprise security, compliance, documentation, and governance standards.

BASIC REQUIREMENTS

2+ years of experience building AI agents or conversational AI solutions (LLM-based assistants, chatbots, voicebots), or in AI/ML or software development with hands-on agent work.

Bachelor's degree in Computer Science, Engineering, Information Technology, Data Science, or equivalent experience.

Hands-on experience designing, building, or tuning LLM-based AI agents or digital assistants, including prompts, tool and function calling, workflows, guardrails, and handoff to a human agent.

Hands-on experience with prompt engineering, conversational design, intent modeling, or Natural Language Understanding (NLU).

Working knowledge of agentic AI patterns: multi-step tool use, retrieval (RAG), evaluation and testing of agents, and the ways an agent can fail in production. This can come from any agent platform; Sierra experience is a plus, not a requirement.

Experience analyzing data and leveraging insights to improve AI performance and user outcomes.

Knowledge of APIs, JSON, and modern software development practices, including the ability to read API responses, logs, and conversation transcripts to work out why an agent behaved the way it did.

Familiarity with CI/CD pipelines, version control systems, and testing methodologies.

Strong problem-solving, communication, and cross-functional collaboration skills.

PREFERRED SKILLS/EXPERIENCE

Experience with multi-agent systems, agent frameworks or SDKs (e.g., LangGraph, OpenAI Agents SDK, Bedrock Agents, Vertex Agent Builder), or MCP-based tool integration.

Hands-on experience with Sierra Agent OS (a new platform; we will train the right candidate), or with other agent platforms such as Salesforce Agentforce, Google CCAI/Dialogflow, Amazon Lex/Connect, Kore.ai, or Microsoft Copilot Studio.

Hands-on experience with voice AI, chatbots, virtual assistants, or customer-service automation solutions.

Knowledge of multi-LLM routing, orchestration, retrieval-augmented generation (RAG), or AI evaluation frameworks.

Experience in healthcare, regulated industries, or enterprise-scale environments.

Exposure to analytics and monitoring tools used to evaluate conversational AI performance.

Experience with simulation-based or automated testing of conversational agents (e.g., Tosca or custom test harnesses).

Familiarity with the systems a contact center agent typically integrates with: Five9 or another CCaaS platform, Salesforce Service Cloud, SAP, or MuleSoft APIs.

Experience collaborating with product, architecture, platform engineering, and business teams.

Familiarity with cloud-native application development and integration patterns.

TRAVEL / WORK LOCATION / PHYSICAL REQUIREMENTS

Minimal travel, based on business needs.

Hybrid or remote work arrangements subject to business and team requirements.

Ability to work at a computer and participate in virtual and in-person meetings for extended periods.

We are proud to offer a competitive compensation package at McKesson as part of our Total Rewards. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets. The pay range shown below is aligned with McKesson's pay philosophy, and pay will always be compliant with any applicable regulations. In addition to base pay, other compensation, such as an annual bonus or long-term incentive opportunities may be offered. For more information regarding benefits at McKesson, please click here.

Our Base Pay Range for this position

$81,500 - $108,600

McKesson has become aware of online recruiting-related scams in which individuals who are not affiliated with or authorized by McKesson are using McKesson’s (or affiliated entities, like CoverMyMeds or RxCrossroads) name in fraudulent emails, job postings or social media messages. In light of these scams, please bear the following in mind: McKesson Talent Advisors will never solicit money or credit card information in connection with a McKesson job application.

McKesson Talent Advisors do not communicate with candidates via online chatrooms or using email accounts such as Gmail or Hotmail. Note that McKesson does rely on a virtual assistant (Gia) for certain recruiting-related communications with candidates.

McKesson job postings are posted on our career site: careers.mckesson.com.

McKesson is an Equal Opportunity Employer

McKesson provides equal employment opportunities to applicants and employees, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age, genetic information, or any other legally protected category. For additional information on McKesson’s full Equal Employment Opportunity policies, visit our Equal Employment Opportunity page.

McKesson is committed to being an Equal Employment Opportunity Employer and offers opportunities to all job seekers including job seekers with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to (United States) [email protected] or (Canada) [email protected]. Resumes or CVs submitted to this email box will not be accepted.

Join us at McKesson!

Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Technology, Data Science, or equivalent experience.
  • Hands-on experience with prompt engineering, conversational design, intent modeling, or Natural Language Understanding (NLU).
  • Familiarity with CI/CD pipelines, version control systems, and testing methodologies.
  • Experience with multi-agent systems, agent frameworks or SDKs (e.g., LangGraph, OpenAI Agents SDK, Bedrock Agents, Vertex Agent Builder), or MCP-based tool integration.
  • Hands-on experience with Sierra Agent OS (a new platform; we will train the right candidate), or with other agent platforms such as Salesforce Agentforce, Google CCAI/Dialogflow, Amazon Lex/Connect, Kore.ai, or Microsoft Copilot Studio.
  • Hands-on experience with voice AI, chatbots, virtual assistants, or customer-service automation solutions.
  • Experience with simulation-based or automated testing of conversational agents (e.g., Tosca or custom test harnesses).
  • Familiarity with the systems a contact center agent typically integrates with: Five9 or another CCaaS platform, Salesforce Service Cloud, SAP, or MuleSoft APIs.
  • Familiarity with cloud-native application development and integration patterns.

Responsibilities

  • Design, configure, and optimize conversational AI agents within Sierra Agent OS.
  • Build reusable reference models and design patterns for multiple business use cases.
  • Develop and refine agent experiences across voice, chat, and email channels.
  • Analyze conversation data and performance metrics to improve accuracy, containment, and customer outcomes.
  • Create and optimize prompts, workflows, decision logic, and handoff experiences.
  • Collaborate with platform engineers and solution architects on multi-LLM orchestration strategies.
  • Support testing, deployment, monitoring, and continuous improvement of AI agent solutions.
  • Run agent simulations and regression tests before each release, and review production conversations where the agent fell short to find the cause and fix it.
  • Work with the integration and platform teams on the APIs and tools the agents call (account lookup, order status, case creation, appointment scheduling) and on how the agent should behave when those calls fail.
  • Maintain agent documentation, test cases, and the support runbooks that the service desk and L3 support teams rely on.
  • Follow enterprise security, compliance, documentation, and governance standards.
  • 2+ years of experience building AI agents or conversational AI solutions (LLM-based assistants, chatbots, voicebots), or in AI/ML or software development with hands-on agent work.
  • Bachelor's degree in Computer Science, Engineering, Information Technology, Data Science, or equivalent experience.
  • Hands-on experience designing, building, or tuning LLM-based AI agents or digital assistants, including prompts, tool and function calling, workflows, guardrails, and handoff to a human agent.
  • Hands-on experience with prompt engineering, conversational design, intent modeling, or Natural Language Understanding (NLU).
  • Working knowledge of agentic AI patterns: multi-step tool use, retrieval (RAG), evaluation and testing of agents, and the ways an agent can fail in production. This can come from any agent platform; Sierra experience is a plus, not a requirement.
  • Experience analyzing data and leveraging insights to improve AI performance and user outcomes.
  • Knowledge of APIs, JSON, and modern software development practices, including the ability to read API responses, logs, and conversation transcripts to work out why an agent behaved the way it did.
  • Familiarity with CI/CD pipelines, version control systems, and testing methodologies.
  • Strong problem-solving, communication, and cross-functional collaboration skills.
  • Experience with multi-agent systems, agent frameworks or SDKs (e.g., LangGraph, OpenAI Agents SDK, Bedrock Agents, Vertex Agent Builder), or MCP-based tool integration.
  • Hands-on experience with Sierra Agent OS (a new platform; we will train the right candidate), or with other agent platforms such as Salesforce Agentforce, Google CCAI/Dialogflow, Amazon Lex/Connect, Kore.ai, or Microsoft Copilot Studio.
  • Hands-on experience with voice AI, chatbots, virtual assistants, or customer-service automation solutions.
  • Knowledge of multi-LLM routing, orchestration, retrieval-augmented generation (RAG), or AI evaluation frameworks.
  • Experience in healthcare, regulated industries, or enterprise-scale environments.
  • Exposure to analytics and monitoring tools used to evaluate conversational AI performance.
  • Experience with simulation-based or automated testing of conversational agents (e.g., Tosca or custom test harnesses).
  • Familiarity with the systems a contact center agent typically integrates with: Five9 or another CCaaS platform, Salesforce Service Cloud, SAP, or MuleSoft APIs.
  • Experience collaborating with product, architecture, platform engineering, and business teams.
  • Familiarity with cloud-native application development and integration patterns.
  • Minimal travel, based on business needs.
  • Hybrid or remote work arrangements subject to business and team requirements.
  • Ability to work at a computer and participate in virtual and in-person meetings for extended periods.
  • We are proud to offer a competitive compensation package at McKesson as part of our Total Rewards. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets. The pay range shown below is aligned with McKesson's pay philosophy, and pay will always be compliant with any applicable regulations. In addition to base pay, other compensation, such as an annual bonus or long-term incentive opportunities may be offered. For more information regarding benefits at McKesson, please click here.
  • Our Base Pay Range for this position
  • $81,500 - $108,600
  • McKesson has become aware of online recruiting-related scams in which individuals who are not affiliated with or authorized by McKesson are using McKesson’s (or affiliated entities, like CoverMyMeds or RxCrossroads) name in fraudulent emails, job postings or social media messages. In light of these scams, please bear the following in mind:
  • McKesson Talent Advisors will never solicit money or credit card information in connection with a McKesson job application.
  • McKesson Talent Advisors do not communicate with candidates via online chatrooms or using email accounts such as Gmail or Hotmail. Note that McKesson does rely on a virtual assistant (Gia) for certain recruiting-related communications with candidates.
  • McKesson job postings are posted on our career site: careers.mckesson.com.
  • McKesson is an Equal Opportunity Employer
  • McKesson provides equal employment opportunities to applicants and employees, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age, genetic information, or any other legally protected category. For additional information on McKesson’s full Equal Employment Opportunity policies, visit our Equal Employment Opportunity page.
  • McKesson is committed to being an Equal Employment Opportunity Employer and offers opportunities to all job seekers including job seekers with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to (United States) [email protected] or (Canada) [email protected]. Resumes or CVs submitted to this email box will not be accepted.
  • Join us at McKesson!

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at McKesson