Senior Vice President, AI / Machine Learning Software Engineer
Key Skills for This Role
Full Job Posting
Key Responsibilities
- Design and build production ‐ ready RAG pipelines, including retrieval, ranking, prompt orchestration, and response generation, with comprehensive guardrails, tracing, and observability.
- Implement offline and online evaluation frameworks for prompts, models, and datasets, including quality, safety, latency, and cost metrics.
- Own end ‐ to ‐ end lifecycle management for GenAI systems, covering prompt versions, model versions, datasets, and configurations.
- Establish and maintain CI/CD pipelines for prompts, models, and data, enabling safe, repeatable, and auditable releases.
- Implement cost and performance monitoring, including token usage, inference latency, throughput, and spend optimization.
- Build and enforce safety mechanisms, such as content filtering, policy enforcement, red‐teaming feedback loops, and abuse detection.
- Define and operationalize incident management workflows, including alerting, triage, rollback mechanisms, and post‐incident analysis.
- Partner closely with product, platform, and governance teams to ensure GenAI solutions meet enterprise reliability, security, and compliance standards.
- Mentor engineers and influence best practices for building scalable, trustworthy AI systems.
Required Qualifications
- Strong experience building and operating production ML or GenAI systems in enterprise environments.
- Deep hands‐on expertise with LLM orchestration frameworks, such as LangChain and/or LlamaIndex.
- Experience with model registries and experiment tracking, such as MLflow or equivalent.
- Solid understanding of Kubernetes ‐ based deployments and cloud‐native architectures.
- Familiarity with feature stores, data pipelines, and retriever/index lifecycle management.
- Proven experience implementing telemetry, logging, metrics, and distributed tracing for ML/AI workloads.
- Strong knowledge of CI/CD practices for ML, GenAI, and data‐driven systems.
Preferred Qualifications
- Experience operating LLM systems at scale, including multi‐model or multi‐provider strategies.
- Exposure to AI safety, governance, and compliance frameworks in regulated environments.
- Background in SRE, platform engineering, or MLOps, with a reliability‐first mindset.
- Ability to translate ambiguous GenAI use cases into robust, production ‐ grade architectures.
- What Success Looks Like
- GenAI systems that are observable, measurable, and resilient, not “black boxes.”
- Safe and cost‐efficient RAG pipelines running reliably in production.
- Fast iteration cycles with strong controls, enabling teams to ship GenAI features with confidence.
- At BNY, our culture speaks for itself, check out the latest BNY news at:
- BNY Newsroom
- BNY LinkedIn
- Here’s a few of our recent awards:
- America’s Most Innovative Companies, Fortune, 2025
- World’s Most Admired Companies, Fortune 2025
- “Most Just Companies”, Just Capital and CNBC, 2025
- Our Benefits and Rewards:
- BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life’s journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.
- BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans. BNY assesses market data to ensure a competitive compensation package for our employees. The base salary for this position is expected to be between $120,000 and $200,000 per year at the commencement of employment. However, base salary if hired will be determined on an individualized basis, including as to experience and market location, and is only part of the BNY total compensation package, which, depending on the position, may also include commission earnings, discretionary bonuses, short and long-term incentive packages, and Company-sponsored benefit programs. This position is at-will and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation) at any time, including for reasons related to individual performance, change in geographic location, Company or individual department/team performance, and market factors.
- BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.
- BNY assesses market data to ensure a competitive compensation package for our employees. The base salary for this position is expected to be between $120,000 and $200,000 per year at the commencement of employment. However, base salary if hired will be determined on an individualized basis, including as to experience and market location, and is only part of the BNY total compensation package, which, depending on the position, may also include commission earnings, discretionary bonuses, short and long-term incentive packages, and Company-sponsored benefit programs.
- This position is at-will and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation) at any time, including for reasons related to individual performance, change in geographic location, Company or individual department/team performance, and market factors.
About BNY External Career Site
A global financial services platform at the heart of the world's capital markets.
Visit company websiteApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at BNY External Career Site
Vice President Liquidity Product Owner
London, GBR
At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of th
Senior Vice President, Hedge Fund Accounting Manager
Lake Mary, USA
In this role, you’ll make an impact in the following ways: Direct multiple Fund Accounting teams responsible for conducting accounting services on behalf of a broad array of assigned clients including determining net ass
Associate Liquidity Product Owner
New York City, USA
We’re seeking a future team member for the role of Associate Liquidity Product Owner to join our Global Markets team. This role is located in New York, NY. In this role, you’ll make an impact in the following ways: Suppo
Senior Specialist, Real Estate Asset Management
New York City, USA
In this role, you’ll make an impact in the following ways: Manage and optimize real estate asset portfolios by conducting thorough market analysis and performance evaluations. May assist in lease administration and facil
Vice President, POM Product Specialist
New York City, USA
We are seeking a Vice President, Product Manager to join our Loan Entablements team. The role would be located in our New York, NY offices. Join BNY’s Loans Enablement Platform team and help shape the future of product i
Senior Vice President, POM Product Specialist
New York City, USA
We are seeking a Senior Vice President, Product Manager for our Loan Entablements platform. This role is located in our New York, NY offices. Join BNY’s Loans Enablement Platform team and help shape the future of product
Senior Associate, Full-Stack Engineer
Pittsburgh, USA
We’re seeking a future team member for the role of Senior Associate, Full Stack Engineer to join our Enterprise Onboarding platform team. This role is located in Pittsburgh, PA. In this role, you’ll make an impact in the
Associate, Infrastructure Engineer
Pune, IND
Associate, Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial sy
Vice President Liquidity Product Owner
London, GBR
Senior Vice President, Hedge Fund Accounting Manager
Lake Mary, USA
Associate Liquidity Product Owner
New York City, USA
Senior Specialist, Real Estate Asset Management
New York City, USA
Vice President, POM Product Specialist
New York City, USA
Senior Vice President, POM Product Specialist
New York City, USA
Senior Associate, Full-Stack Engineer
Pittsburgh, USA
Associate, Infrastructure Engineer
Pune, IND