{bc}
zoho_recruit

AI Senior Engineer Tech lead

Money Forward India
Chennai, IND
Full-time
Senior
Onsite
Discovered 3 weeks ago
GitHubYAMLDeepEvalPromptfooGitCI

Full Job Posting

Context engineering skills

  • RAG and retrieval pipelines:Design advanced search and retrieval systems that supply models with accurate, relevant, and timely information.
  • Context-window and token management:Compress conversation history, prioritize useful context, and filter noise to optimize model attention and cost.
  • Memory architecture:Build short-term and persistent memory systems that allow agents to retain state across tasks and interactions.
  • Instruction curation:Structure plain-English operating rules, Markdown files, domain guides, and other instructions for dynamic injection into agent tasks.
  • Context formats and knowledge modeling:Design context layers and reusable knowledge assets using Markdown, YAML, schemas, and related formats.

Harness engineering skills

  • Tool and MCP integration: Connect models to external APIs, execution environments, tools, and Model Context Protocol (MCP) servers.
  • Sandboxing and permissions: Define safety boundaries, access controls, approval flows, and secure execution environments for agent actions.
  • Validation and guardrails: Implement linters, automated tests, evaluations, and verification layers that detect hallucinations, policy violations, or broken code.
  • Orchestration and control loops: Design multi-step workflows, retry logic, state transitions, and error-correction loops for long-horizon tasks.
  • Evaluation harnesses: Build fixtures, benchmark tasks, quality gates, and CI-integrated evaluations using DeepEval, Promptfoo, or comparable frameworks

Supporting technical and leadership skills

  • LLM and agent fundamentals: Strong understanding of agent workflows, RAG, evaluation methods, and quality gates for AI-generated output.
  • Software engineering:Strong Git/GitHub and CI practices, experience with repo-native tooling, and the ability to prototype quickly.
  • Technical leadership: Ability to make pragmatic architecture decisions, lead POCs, and turn evidence into reusable standards.
  • Communication: Ability to write clear technical proposals and provide constructive cross-team review and feedback.
  • Experience with ontology or knowledge modeling using YAML-based schemas.
  • Familiarity with internal or external agent platforms.
  • Experience with hybrid search, indexing pipelines, or context freshness mechanisms.

Success outcomes

Context architecture, format, and evaluation standards are validated through representative pilots.

Pilot teams can convert source knowledge and author evaluation fixtures using documented playbooks.

A working repo-native harness POC demonstrates repeatable benchmark execution and quality gates.

The committee has sufficient evidence to ratify the standard and decide whether to adopt or build the long-term harness.

Requirements

  • RAG and retrieval pipelines:Design advanced search and retrieval systems that supply models with accurate, relevant, and timely information.
  • Context-window and token management:Compress conversation history, prioritize useful context, and filter noise to optimize model attention and cost.
  • Memory architecture:Build short-term and persistent memory systems that allow agents to retain state across tasks and interactions.
  • Instruction curation:Structure plain-English operating rules, Markdown files, domain guides, and other instructions for dynamic injection into agent tasks.
  • Context formats and knowledge modeling:Design context layers and reusable knowledge assets using Markdown, YAML, schemas, and related formats.
  • Tool and MCP integration: Connect models to external APIs, execution environments, tools, and Model Context Protocol (MCP) servers.
  • Sandboxing and permissions: Define safety boundaries, access controls, approval flows, and secure execution environments for agent actions.
  • Validation and guardrails: Implement linters, automated tests, evaluations, and verification layers that detect hallucinations, policy violations, or broken code.
  • Orchestration and control loops: Design multi-step workflows, retry logic, state transitions, and error-correction loops for long-horizon tasks.
  • Evaluation harnesses: Build fixtures, benchmark tasks, quality gates, and CI-integrated evaluations using DeepEval, Promptfoo, or comparable frameworks
  • LLM and agent fundamentals: Strong understanding of agent workflows, RAG, evaluation methods, and quality gates for AI-generated output.
  • Software engineering:Strong Git/GitHub and CI practices, experience with repo-native tooling, and the ability to prototype quickly.
  • Technical leadership: Ability to make pragmatic architecture decisions, lead POCs, and turn evidence into reusable standards.
  • Communication: Ability to write clear technical proposals and provide constructive cross-team review and feedback.
  • Experience with ontology or knowledge modeling using YAML-based schemas.
  • Familiarity with internal or external agent platforms.
  • Experience with hybrid search, indexing pipelines, or context freshness mechanisms.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today