Senior Software Engineer - Search Runtime
Key Skills for This Role
Full Job Posting
The Role
We are looking for a Senior Software Engineer to work on the runtime systems of a novel search engine tailored for agentic AI consumption. In this role, you will focus on building low-latency, high-throughput systems that serve search queries in real time. You will work on the critical path of user-facing requests, where performance, predictability, and efficiency directly impact product quality. You will design and operate systems that handle thousands of requests per second under strict latency budgets, optimizing every layer from request handling to data access and response assembly.
In this position, your responsibility will be to
- Design, implement, and operate core runtime services for serving search queries
- Build and optimize request flows (query processing, retrieval orchestration, response assembly)
- Develop systems that meet strict latency budgets under high load
- Optimize CPU, memory, and data access patterns in performance-critical paths
- Ensure reliability, observability, and predictability in production
- Build well-tested systems with clear boundaries while allowing architectural evolution
- Define observability primitives (logs, metrics, traces, latency breakdowns)
- Monitor and improve latency, throughput, and cost efficiency
- Collaborate with indexing and ML teams to integrate retrieval and ranking components
- Support experimentation through controlled rollouts and benchmarking
You may be a good fit if you
Have 5+ years of experience building production backend systems
Have strong expertise in C++ or Rust
Have experience with high-load, low-latency user-facing systems
Have worked on systems handling thousands of RPS under strict latency constraints
Understand performance at a systems level (CPU, memory, networking)
Have operated services in production and handled incidents and debugging
Understand distributed systems fundamentals and tradeoffs
Think end-to-end about request flows rather than isolated components
Can balance correctness, latency, and development speed
Collaborate effectively across engineering, ML, and product
Strong candidates may also have experience with
DBMS (OSS or SaaS) and cloud infrastructure
High-load web applications or large-scale APIs
Performance-critical systems (e.g. trading platforms)
Low-level performance tuning and optimization
Open-source contributions
Competitive programming or CTFs
SHAD or similar advanced programs
Conference talks or technical publications
We conduct coding interviews as part of the process.
What we offer
- Competitive salary and comprehensive benefits package.
- Opportunities for professional growth within Nebius.
- Flexible working arrangements.
- A dynamic and collaborative work environment that values initiative and innovation.
- We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!
About Nebius
Verified company details for this employer are not available yet.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Nebius
Business Development Representative (BDR)- AI Native
San Francisco, USA
Senior Software Engineer (Agentic Search) - Web Access Engineer
, GBR
EME Tax Specialist
, IND
Staff Software Engineer (Agentic Search) - Runtime
, GBR
Senior ML Engineer (Agentic Search)
, GBR
Staff Software Engineer (Agentic Search) - Runtime
, GBR
Staff Software Engineer (Agentic Search) - Crawler
, GBR
Senior Customer AI Engineer
, USA