Senior Staff Developer, AI and Machine Learning

About Benevity

Role overview

What you'll do

• Design ML architecture spanning ingestion, feature stores, model serving, and monitoring; define the AI infrastructure and orchestration roadmap.
• Oversee the AI/ML ecosystem and build self-service APIs, SDKs, and standards for other teams.
• Set MLOps standards and work with Product Managers, Data Scientists, and ML Engineers to translate business needs into technical requirements.
• Lead design reviews and mentor engineers in system design and performance optimization.
• Architect LLM applications including copilots, search, assistants, agents, RAG, tools, and multi-step workflows.
• Build GenAI evaluation frameworks using offline benchmarks, online metrics, and human-in-the-loop feedback.
• Establish prompt, agent, and orchestration practices; implement safeguards for prompt injection, hallucinations, and responsible AI.
• Set model versioning, A/B testing, rollback, and drift-management practices; align architecture with security and regulations.
• Identify process improvements and implement solutions that increase platform performance and efficiency.

What you'll bring

• Bachelor's or master's degree in Computer Science, Mathematics, or a related field, or equivalent deep professional experience.
• At least 8 years of software engineering experience, including 4 or more years architecting and deploying production ML models at scale.
• At least 2 years in technical leadership building scalable platforms or leading technology transformation and modernization.
• Staff- or Senior-level technical leadership, architecture ownership, and mentoring experience.
• Experience building internal platforms or self-service infrastructure for engineering teams.
• Expertise in production MLOps, cloud AI/ML workloads, data architecture, ML tools, CI/CD, Python, and ML frameworks.
• Experience with LLM systems, prompt orchestration, RAG, agentic workflows, distributed systems, governance, and responsible AI.
• Ability to translate ambiguous business problems into scalable solutions and influence stakeholders across teams.
• A relevant cloud-platform or technology certification is a plus.

Where we work

• Benevity describes its workplace approach as flexible hybrid, with no set in-office time requirement for people near an office.