Software Engineer, Systems ML

Role overview

Responsibilities

• Design and optimize large-scale ML training and inference systems, distributed frameworks, and hardware-accelerated pipelines.
• Develop and maintain performance-critical ML infrastructure in C++ and Python.
• Profile, instrument, and benchmark systems to find and resolve performance bottlenecks.
• Architect ML system trade-offs involving memory bandwidth, compute utilization, and I/O throughput.
• Translate model requirements into infrastructure solutions with research and product teams.
• Write automated tests and build production monitoring and alerting.
• Support staged rollouts, document infrastructure changes, and participate in on-call incident response and retrospectives.
• Review code and contribute to engineering quality initiatives.

Minimum qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or relevant technical field, or equivalent practical experience; degree must be completed before joining.
• 2+ years of software engineering experience focused on ML systems, AI infrastructure, or high-performance computing.
• Experience developing or optimizing ML training or inference pipelines using PyTorch, TensorFlow, or equivalent.
• Experience with distributed computing architectures and large-scale ML systems design.
• Experience programming in C++ and Python for performance-critical systems.
• Experience using profiling and performance-analysis tools to identify and resolve bottlenecks.

Preferred qualifications

• Experience integrating AI tools to improve workflows and deliver measurable impact; responsible and ethical AI practices; and continued AI skill development are preferred.
• Experience with MLIR, LLVM, TVM, XLA, or IREE is preferred.
• GPU programming with CUDA, ROCm, or equivalent accelerator kernel development is preferred.
• GPU or TPU optimization of large-scale ranking or recommendation inference is preferred.
• Hardware-software co-design, numerics optimization, and SIMD or vectorization experience are preferred.

About Meta

Compensation

• Base salary is $121,992–$181,000 per year, plus bonus, equity, and benefits.
• Individual compensation depends on skills, qualifications, experience, and location.