{bc}
Apply
workday

Senior Software Engineer - AI

Bluehost
Québec, CAN
Senior
Remote
Discovered 3 weeks ago
azuredockerfastapikafkakubernetesopentelemetry

Full Job Posting

Nice to have.

  • You should be comfortable going beyond a working demo and understand how modern AI systems behave, fail, and scale in production.
  • Strong understanding of prompting, structured outputs, tool schemas, context management, model routing, retries, fallbacks, rate limits, and streaming responses.
  • Ability to design experiments and evaluations that compare approaches using measurable outcomes rather than subjective testing alone.
  • Understanding of retrieval quality, grounding, hallucination mitigation, prompt injection risks, tool authorization, and practical agent guardrails.
  • Experience with Docker, CI/CD, automated testing, observability, distributed tracing, OpenTelemetry, Langfuse, or similar tooling.
  • How you’ll work
  • You will often start with an ambiguous customer or product goal rather than a detailed implementation plan. You should be able to independently break the problem down, validate assumptions, choose an approach, and drive the solution through production.
  • Turn product goals into testable technical hypotheses and rapidly prototype alternatives when needed.
  • Choose the simplest architecture that solves the problem well rather than using an agent or LLM by default.
  • Define quality, latency, reliability, safety, and cost targets and measure production performance against them.
  • Own implementation across APIs, workflows, data, queues, model integration, evaluations, observability, and production support.
  • Use AI coding agents aggressively to increase engineering velocity while preserving architecture quality, testing discipline, security, and maintainability.
  • What will make you stand out
  • Experience with Semantic Kernel, Microsoft Agent Framework, LangGraph, PydanticAI, or equivalent agent frameworks.
  • Experience building or consuming Model Context Protocol tools and servers, or working with model gateways such as LiteLLM.
  • Experience with Azure AI Search, pgvector, Chroma, Kubernetes, Azure, OCI, or similar production AI platform technologies.
  • Experience building high scale customer facing AI products, open weight model inference, AI safety controls, or automated agent evaluation systems.
  • Strong problem solving, excellent engineering judgment, and the ability to independently move from ambiguity to a production quality solution are the foundation for this role.
  • Join us to build the agent-powered backbone of our AI platform—robust, model agnostic, and ready for millions of users.
  • This Job Description includes the essential job functions required to perform the job described above, as well as additional duties and responsibilities. This Job Description is not an exhaustive list of all functions that the employee performing this job may be required to perform. The Company reserves the right to revise the Job Description at any time, and to require the employee to perform functions in addition to those listed above.

Qualifications

  • 5 or more years of professional software engineering experience building production backend, distributed, or cloud based systems.
  • Hands on experience building Applied AI, LLM, RAG, NLP, or agent based applications, with meaningful production exposure.
  • Advanced Python skills including FastAPI, asynchronous programming, Pydantic, SQLAlchemy or SQLModel, and production API development.
  • Strong backend and distributed systems fundamentals including REST APIs, concurrency, background processing, caching, reliability, and production debugging.
  • Production experience with RabbitMQ, Kafka, Azure Service Bus, or equivalent queue and messaging architectures.
  • Hands on experience integrating LLM APIs and building structured output, function calling, tool calling, or agent execution workflows.
  • Experience building at least one RAG or knowledge grounded system with measurable quality and latency outcomes.
  • Strong PostgreSQL and data modeling skills, with experience using Redis, pgvector, vector databases, or hybrid search technologies.
  • Demonstrated use of AI coding agents such as Cursor, Claude Code, Codex, or equivalent tools as a core part of daily software engineering.
  • Nice to have.
  • You should be comfortable going beyond a working demo and understand how modern AI systems behave, fail, and scale in production.
  • Strong understanding of prompting, structured outputs, tool schemas, context management, model routing, retries, fallbacks, rate limits, and streaming responses.
  • Ability to design experiments and evaluations that compare approaches using measurable outcomes rather than subjective testing alone.
  • Understanding of retrieval quality, grounding, hallucination mitigation, prompt injection risks, tool authorization, and practical agent guardrails.
  • Experience with Docker, CI/CD, automated testing, observability, distributed tracing, OpenTelemetry, Langfuse, or similar tooling.
  • How you’ll work
  • You will often start with an ambiguous customer or product goal rather than a detailed implementation plan. You should be able to independently break the problem down, validate assumptions, choose an approach, and drive the solution through production.
  • Turn product goals into testable technical hypotheses and rapidly prototype alternatives when needed.
  • Choose the simplest architecture that solves the problem well rather than using an agent or LLM by default.
  • Define quality, latency, reliability, safety, and cost targets and measure production performance against them.
  • Own implementation across APIs, workflows, data, queues, model integration, evaluations, observability, and production support.
  • Use AI coding agents aggressively to increase engineering velocity while preserving architecture quality, testing discipline, security, and maintainability.
  • What will make you stand out
  • Experience with Semantic Kernel, Microsoft Agent Framework, LangGraph, PydanticAI, or equivalent agent frameworks.
  • Experience building or consuming Model Context Protocol tools and servers, or working with model gateways such as LiteLLM.
  • Experience with Azure AI Search, pgvector, Chroma, Kubernetes, Azure, OCI, or similar production AI platform technologies.
  • Experience building high scale customer facing AI products, open weight model inference, AI safety controls, or automated agent evaluation systems.
  • Strong problem solving, excellent engineering judgment, and the ability to independently move from ambiguity to a production quality solution are the foundation for this role.
  • Join us to build the agent-powered backbone of our AI platform—robust, model agnostic, and ready for millions of users.
  • This Job Description includes the essential job functions required to perform the job described above, as well as additional duties and responsibilities. This Job Description is not an exhaustive list of all functions that the employee performing this job may be required to perform. The Company reserves the right to revise the Job Description at any time, and to require the employee to perform functions in addition to those listed above.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Bluehost

Software Engineer

, CAN

Discovered 3 days agoFull-time

Application Security Engineer

, CAN

Discovered 4 days agoFull-time

Account Services II

Glasgow, GBR

Discovered 5 days agoFull-time

Fraud Operation Associate

Mumbai, IND

Discovered 2 weeks agoFull-time

Senior Backend Engineer

Mumbai, IND

Discovered 2 weeks agoFull-time

Business Development Representative

, USA

Discovered 2 weeks ago

Backend Engineer

, USA

Discovered 3 weeks ago

Senior Backend Engineer

, USA

Discovered 3 weeks agoFull-time