Principal Software Engineer — Backend & Infrastructure - Noida / Bengaluru
Role Overview
This principal role sets technical direction for backend and ML infrastructure across multiple teams.
Partner with ML, Product, and Infrastructure leads and report to the VP of Engineering.
Key Skills for This Role
Full Job Posting
About Level AI
Level AI provides conversational intelligence for enterprise contact centers using speech AI, NLP/NLU, and retrieval systems.
Role overview
This principal role sets technical direction for backend and ML infrastructure across multiple teams.
Partner with ML, Product, and Infrastructure leads and report to the VP of Engineering.
What you will do
- Own architecture for real-time data processing and distributed messaging systems with strict latency requirements.
- Define and execute the roadmap for model training and serving infrastructure.
- Own GPU capacity planning, scheduling, utilization, and burst-demand handling.
- Improve inference latency and cost through batching, routing, quantization, compilation, autoscaling, and caching.
- Drive uptime, observability, and incident response for production serving systems.
- Turn business problems into executable cross-functional technical plans.
- Lead design reviews, mentor senior engineers, and shape engineering standards.
- Evaluate emerging tools and techniques for practical adoption.
- Comply with company security, privacy, data-protection, and acceptable-use policies.
What you will bring
- 10+ years building backend and infrastructure systems with architecture ownership at scale.
- Deep hands-on experience with large-scale databases, high-throughput messaging systems, and real-time job queues.
- Ability to reason about architectural tradeoffs in large, complex codebases.
- Experience mentoring senior engineers and influencing technical decisions.
- Strong written communication for engineering and executive audiences.
- BTech, MTech, PhD in Computer Science, or equivalent; track record is emphasized over credentials.
Bonus experience
- Production experience with Django, Celery, Redis, PostgreSQL, and Google Cloud.
- Experience scaling production GPU infrastructure and model inference.
- Experience with vLLM, TensorRT, Triton, Ray Serve, or equivalent inference tooling.
- Experience scaling a platform through a comparable growth stage.
- Background in speech, NLP, or information retrieval systems.
Benefits
- Health coverage is offered for the employee, spouse, children, and parents.
- The posting references home-office, connectivity, learning, and parental-leave benefits, subject to confirmation.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Level AI
Senior Machine Learning Engineer - NLP (Bangalore/Noida Location)
Noida, IND
Level AI seeks a Senior Machine Learning Engineer to develop production NLP and LLM solutions for contact-center products. You will build scalable pipelines, optimize models, deploy AI services, and improve evaluation an
Senior Site Reliability Engineer (Remote, India) EST
, IND
Senior Frontend Engineer
Noida, IND
Forward Deployed Engineer - Agents(Remote)
, IND
Technical Account Manager(India, Remote)
, IND
Technical Account Manager(India, Remote)
, IND
Lead Software Engineer
Noida, IND
Senior Machine Learning Engineer - NLP (Bangalore/Noida Location)
Noida, IND
Principal Machine Learning Engineer
Bengaluru, IND
Senior Site Reliability Engineer (Remote, India) EST
, IND