Senior Director, Network Reliability Engineering

Nice to Have

• Experience in GPU cloud, HPC, or AI/ML infrastructure environments
• Experience operating InfiniBand or RoCE fabrics at scale, and understanding how network faults affect distributed training jobs
• Experience applying ML or LLM-based tooling to operations, such as anomaly detection, alert correlation, automated triage or root-cause analysis
• Experience with streaming network telemetry at scale (gNMI, OpenConfig or similar)
• Salary Range Information
• The annual salary range for this position has been set based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Lambda

Responsibilities

• Own the reliability of Lambda's network end to end, from GPU compute fabrics to data center, backbone and edge, and be accountable for availability, time to detect and time to restore
• Run break-fix operations at scale: fault detection, triage, hardware replacement and RMA, optics and cabling remediation, and coordination with Data Center Operations and remote-hands partners across a growing fleet of data centers
• Lead the networking ops excellence and incident management program, including on-call, incident command, escalation paths, customer communication and blameless postmortems that turn into engineering fixes
• Set the multi-year strategy for a self-healing network: automated loops that detect and isolate failing components, shift traffic, drain and restore capacity, and open repair work without human intervention
• Convert manual break-fix work into durable software. The goal is a network that repairs itself, not a faster set of runbooks. Measure toil, set targets to reduce it, and track the share of failures resolved automatically as a primary outcome for your org
• Define network SLOs and error budgets with product and customer-facing teams, and use them to prioritize reliability work against feature and capacity work
• Build automation that is safe to trust, with blast-radius limits, staged rollouts, audit trails and rollback for every automated action, including AI-assisted triage and remediation
• Own the operational bar for your org: how incidents are detected, handled, reviewed, measured and learned from
• Build and lead the organization that delivers it: hire, develop and retain engineers and the leaders who manage them, and design the team structure as the network and the org grow
• Manage through leads and senior ICs, developing both, with regular 1:1s, clear performance feedback, growth planning, and sponsorship of meaningful work
• Partner with Network Engineering, Network Capacity Automation, Software and Principal Engineers so reliability requirements are designed in from the start and failure data informs architecture, hardware and vendor decisions
• Partner with Data Center Operations, Supply Chain and vendors on spares strategy, RMA turnaround and hardware failure trends
• Represent your org's work, reliability metrics and technical direction to senior leadership, and to enterprise customers and partners during major incidents and reviews
• Contribute to org-wide engineering process improvements: how we plan, how we ship, how we learn from incidents
• Have 8+ years of engineering management experience, including managing managers and directly managing senior individual contributors
• Proven track record of leading SRE, network reliability or production operations organizations for large-scale cloud or data center networks with 24x7 availability requirements
• Have a network or software engineering background. You've shipped production systems and can engage credibly on architecture, technical tradeoffs, and code quality
• Have measurably reduced toil and incident impact through automation, and can show the data, such as lower time to restore or a higher share of incidents remediated automatically
• Familiarity designing, building, scaling and operating large-scale networks, including routing (BGP), leaf-spine fabrics, optics and hardware failure modes, and network telemetry and monitoring
• Experience building closed-loop or event-driven remediation systems, and the safety controls that keep automation from causing incidents
• Have run incident management at scale: incident command, a blameless postmortem culture, and turning lessons into engineering work that ships
• Foster a data driven, automation first, high velocity organization
• Have a track record of building high-performing teams in fast-moving, technically demanding environments
• Are skilled at translating ambiguous business and product goals into clear team priorities and executable engineering plans
• Show strong judgment about when to go deep technically, when to delegate, and when to escalate
• Stay calm and decisive during major incidents, and communicate clearly with customers and executives while one is in progress
• Excellent communicator both written and verbal. You use high quality written artifacts to inform high quality decision making and get approval on problems and solution opportunities