Global AI/ML Engineer Manager
Role Overview
The LLM Engineer joins an existing development team to build and ship LLM-powered features in a complex production application used at scale.
This is a hands-on, full-stack role covering backend services, APIs, retrieval, agents, and evaluation systems.
The engineer will work with global teams across multiple time zones and own features end to end.
Key Skills for This Role
Full Job Posting
About the Company
Boston Consulting Group partners with business and society leaders to address important challenges and opportunities.
BCG combines management consulting with technology, design, corporate ventures, and business purpose capabilities.
Role Overview
The LLM Engineer joins an existing development team to build and ship LLM-powered features in a complex production application used at scale.
This is a hands-on, full-stack role covering backend services, APIs, retrieval, agents, and evaluation systems.
The engineer will work with global teams across multiple time zones and own features end to end.
Responsibilities
- Execute planning and hands-on technical work independently.
- Collaborate with Product Owners and stakeholders to solve complex problems.
- Work cross-functionally to deliver impactful solutions across teams.
- Use AI coding tools and autonomous agents to write code, automate workflows, and optimize engineering processes.
- Apply data-driven and systems-level thinking to technical challenges.
- Own features and projects while delivering high-quality solutions independently.
- Continuously develop technical expertise and stay current with new technologies.
Required Experience
- At least 2 years of experience developing and experimenting with LLMs.
- At least 8 years of experience developing APIs with Python.
- Daily hands-on use of AI-assisted and agentic coding tools.
- Strong Python experience, particularly building REST APIs with frameworks such as FastAPI.
- Grounding in NLP and machine learning for LLM systems.
- Experience with OpenAI or Anthropic model APIs.
- Experience building, deploying, and securing MCP servers at scale.
Required Technical Skills
- Experience with multi-agent systems and complex problem-solving applications.
- End-to-end RAG design covering vector databases, semantic search, retrieval quality, and chunking strategy.
- Experience with Elasticsearch, OpenSearch, or Solr.
- Experience with prompt writing for varied use cases.
- Experience with Java or confidence using agentic coding skills to develop in Java.
- Experience delivering generative solutions to production at scale beyond proof-of-concept implementations.
- Proficiency with server-sent events, event-driven architectures, and messaging systems.
- Understanding of backend authentication, data protection, and security best practices.
Preferred Skills
- Experience with LLM guardrails.
- Experience with LLM frameworks such as LangChain or LlamaIndex.
- Experience with LLM monitoring and observability.
- Experience developing AI or ML technologies in large, business-critical applications.
- Experience building evaluation into LLM systems through evaluation harnesses, regression suites, LLM-as-judge methods, and quality metrics.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Boston Consulting Group (BCG)
Senior Analyst – BCG Vantage, Implementation (Transformation)
Riyadh, KSA
BCG seeks a Senior Analyst to help clients execute implementation and transformation programs, translating strategies into measurable outcomes. The role involves program delivery, stakeholder alignment, process improveme
Middle East Recruiting Intern
Riyadh, KSA
BCG is seeking a Recruiting Intern to support recruiting operations throughout the recruiting season, including scheduling, events, records, and reporting. Applicants must be final-year university students eligible for C
Middle East HR Center of Expertise Intern
Riyadh, KSA
BCG is seeking a final-year student for an HR Center of Expertise internship focused on benefits and wellbeing, supporting cross-functional projects in areas including risk, compliance, immigration, and employee benefits
Middle East HR Services Intern
Riyadh, KSA
BCG is seeking an HR Services Intern to support regional employee onboarding, documentation, systems updates, and HR administration. Applicants should be final-year university students eligible for COOP in January 2027 a
Middle East Talent Management Intern
Riyadh, KSA
BCG is looking for a final-year university student eligible for COOP to support Talent Management across its Middle East offices. The intern will assist with staffing, career-development processes, administration, and co
Middle East Vendor Management Intern
Riyadh, KSA
BCG seeks a final-year university student eligible for COOP in January 2027 to support vendor screening, onboarding, and internal vendor-management processes. The role requires an undergraduate degree, computer proficien
Riyadh IT Intern
Riyadh, KSA
BCG is seeking a final-year student eligible for a January 2027 COOP to support day-to-day IT operations. The intern will troubleshoot user issues, prepare and track devices, and assist with projects. Candidates should b
Middle East Business Operations Junior Specialist - Case Team Support
Abu Dhabi, UAE
BCG is seeking a junior case team support specialist for a six-month temporary role assisting consulting staff with scheduling, travel, expenses, administrative processes, and client-service needs. Applicants should have
Senior Analyst – BCG Vantage, Implementation (Transformation)
Riyadh, KSA
Middle East Recruiting Intern
Riyadh, KSA
Middle East HR Center of Expertise Intern
Riyadh, KSA
Middle East HR Services Intern
Riyadh, KSA
Middle East Talent Management Intern
Riyadh, KSA
Middle East Vendor Management Intern
Riyadh, KSA
Riyadh IT Intern
Riyadh, KSA
Middle East Business Operations Junior Specialist - Case Team Support
Abu Dhabi, UAE