Infrastructure & Site Reliability Engineer – Datacentre AI Engineering - Riyadh, KSA

Job Area

About Us

About The Role

Key Responsibilities Will Include

Key Responsibilities

• AI Infrastructure
• Design, deploy, and operate large‑scale AI inference systems supporting critical AI workloads.
• Ensure reliability, availability, and scalability of Qualcomm datacenter AI clusters.
• Develop and maintain software tools and support infrastructure around AI software stacks.

• AI & ML Engineering

• Analyze software requirements and collaborate with architecture and hardware engineers to support AI workloads.
• Build, deploy, and operate components supporting LLM inference, agentic AI workflows, and AI services.
• Work with models, systems, and software teams to improve model performance on AI100 deployments.
• Identify and implement optimizations for workloads running on multi‑SoC and multi‑card systems.

• Site Reliability Engineering (SRE)

• Apply SRE fundamentals including monitoring, alerting, incident response, and performance optimization.
• Support production ML systems using MLOps tools and operational best practices.
• Contribute to incident reviews, operational documentation, and continuous reliability improvements.

• Observability & Tooling

• Build and maintain observability tools, dashboards, and alerts to monitor system health and reliability.
• Monitor infrastructure and services using tools such as Prometheus, Grafana, CloudWatch, and custom telemetry.
• Create and maintain technical documentation, runbooks, and knowledge‑base articles.

• Automation & CI And CD

• Develop automation to reduce manual operational tasks and improve system reliability.
• Support CI/CD pipelines for AI service and agent deployment.
• Apply Infrastructure‑as‑Code practices using tools such as Terraform and Ansible.

• AI & Deep Learning

• Experience working with AI/ML workloads such as LLMs, NLP, Vision, Audio, or Recommendation systems.
• Understand ML inference concepts including batching, token streaming, and performance considerations.
• Hands‑on experience with PyTorch and familiarity with modern ML frameworks.
• Familiarity with distributed inference, checkpointing, and accelerator‑based compute environments.
• AI Operations
• Experience supporting AI or ML applications in production environments.
• Familiarity with LLM inference pipelines and AI service operations.

• Programming & Software Design

• Strong programming skills in Python with experience building and supporting production systems.
• Experience with scripting and automation using Python and Bash.
• Familiarity with configuration management and orchestration tools.

• Systems & Infrastructure

• Strong Linux fundamentals include shell, containers, system services, and networking basics (DNS, TLS, HTTP/gRPC).
• Experience working with cluster schedulers such as Slurm or equivalent systems.
• Experience operating distributed systems with high availability and fault tolerance.

• Observability & Monitoring

• Hands‑on experience with monitoring and logging tools such as Prometheus, Grafana, ELK, or Loki.
• Understanding of incident management, service health metrics, and system reliability monitoring.

• DevOps & SRE Practices

• Solid understanding of SDLC, release processes, and operational reliability practices.
• Familiarity with CI/CD pipelines and Infrastructure‑as‑Code tools.

Preferred Skillset

• Experience with GenAI, Agentic AI systems, or LLM orchestration frameworks.
• Exposure to LangChain, AutoGen, or RAG‑based systems.
• Experience with additional ML frameworks such as TensorFlow, JAX, or Ray.
• Knowledge of GPU/accelerator‑based systems and high‑performance networking (RDMA, InfiniBand, RoCE).
• Experience with advanced MLOps workflows or large‑scale AI platform operations.

Qualifications

• Bachelor’s or Master’s degree in engineering, Computer Science, AI/ML, or a related field.
• 2–8 years of software, systems, or infrastructure engineering experience, preferably in production or datacenter environments.

What'S On Offer

• Apart from working with great people, we offer the below:
• Salary including housing & transport allowance
• Stock (RSU's) and performance related bonus
• 16 weeks fully paid Maternity Leave
• 6 weeks fully paid Paternity Leave
• Employee stock purchase scheme

• Child Education Allowance

• Relocation and immigration support (if needed)
• Life and Medical Insurance
• Live+ Well Reimbursement for health and recreational membership fees

Minimum Qualifications

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.

Or

Or

• PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
• 2+ years of work experience with Programming Language such as C, C++, Java, Python, etc.
• References to a particular number of years experience are for indicative purposes only. Applications from candidates with equivalent experience will be considered, provided that the candidate can demonstrate an ability to fulfill the principal duties of the role and possesses the required competencies.
• Qualcomm is an equal opportunity employer.
• If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process.
• You may e-mail [email protected] or call Qualcomm's toll-free number found here.
• Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process.
• Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities.
• We will not respond here to requests for updates on applications or resume inquiries).
• Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.
• To all Staffing and Recruiting Agencies
• : Our Careers Site is only for individuals seeking a job at Qualcomm.
• Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited.
• Qualcomm does not accept unsolicited resumes or applications from agencies.
• Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location.
• Qualcomm is not responsible for any fees related to unsolicited resumes/applications.
• If you would like more information about this role, please contact Qualcomm Careers.