Lead AI Back-End Engineer

Nice to have

• Experience with message queue and event driven architectures using RabbitMQ, Kafka, Azure Service Bus, or equivalent.
• Experience with GPU inference fleets, self hosted open weight models, or serverless model hosting.
• Experience with model gateways, intelligent model routing, MCP, agent interoperability, prompt caching, and LLM cost optimization.
• Familiarity with automatic evaluation pipelines, agent evaluations, LLM as judge techniques, safety guardrails, and cost aware prompt and context engineering.
• Why join the Newfold AI team?
• You’ll steer the core intelligence behind our AI products, building an LLM agnostic, agent driven platform that serves millions of users while meeting enterprise grade standards for reliability, security, governance, and economics. If you thrive on significant technical challenges, enjoy mentoring strong engineers, and want the opportunity to shape both architecture and engineering culture, we’d love to meet you.
• Why you’ll love us.
• Work-life balance. Our work is thrilling and meaningful, but we know balance is key to living well.
• We celebrate one another’s differences. We’re proud of our culture of diversity and inclusion. We foster a culture of belonging. Our company and customers benefit when employees bring their authentic selves to work. We have programs that bring us together on important issues and provide learning and development opportunities for all employees. We have 20 + affinity groups where you can network and connect with Newfolders globally.
• We care about you. We are a family, and we care about you and your family’s physical and mental health by providing competitive HMO benefits – 175k MBL with one free dependent upon one year of service! We also give out Punctuality Bonus, Generous Vacation policy, and much more!
• Where can we take you? We’re fans of helping our employees learn different aspects of the business, be challenged with new tasks, be mentored, and grow their careers. Unfold new possibilities with #teamnewfold!
• The target compensation range for this position is $100k - $180k CAD annually. Individual salaries are determined by various factors including, but not limited to candidate qualifications such as skills, education, and experience, as well as internal equity and market conditions
• #NetworkSolutions