Cloud AI architect
Role Overview
We are seeking a deeply technical, hands-on Private Cloud AI Architect to support a large-scale enterprise operating in a high-security, mission-critical sector.
In this role, you will own the architecture, bare-metal deployment, and day-to-day stability of a high-density, sovereign on-premises AI infrastructure environment.
You will bridge physical bare-metal systems engineering with open-source container orchestration building a high-throughput internal AI utility engineered to host, fine-tune, and serve massive open-weights models (such as Llama, Mistral, and DeepSeek) entirely within secure, physical data center facilities.
Key Skills for This Role
Full Job Posting
Hiring: Cloud AI Architect (Hands-On / Bare-Metal Infrastructure)
Location:
Abu Dhabi, UAE (On-Site)
Employment Type:
Full-Time, Permanent
About the Opportunity
We are seeking a deeply technical, hands-on Private Cloud AI Architect to support a large-scale enterprise operating in a high-security, mission-critical sector.
In this role, you will own the architecture, bare-metal deployment, and day-to-day stability of a high-density, sovereign on-premises AI infrastructure environment.
You will bridge physical bare-metal systems engineering with open-source container orchestration building a high-throughput internal AI utility engineered to host, fine-tune, and serve massive open-weights models (such as Llama, Mistral, and DeepSeek) entirely within secure, physical data center facilities.
Key Responsibilities
- Deploy Red Hat OpenShift via CLI using CoreOS Ignition. Configure multi-tenant RBAC, NMState (100G/400G bonding, VLANs), and Kubeflow/Tekton pipelines.
- Deploy and tune NVIDIA NIM, vLLM, Triton, and TensorRT-LLM on next-gen SXM GPUs. Configure MIG and fractional GPU slicing via CLI.
- Tune Linux kernels (sysctl, AMD EPYC NUMA balancing), patch NVIDIA drivers/NCCL, and validate GPUDirect RDMA on Quantum InfiniBand fabrics.
- Write Ansible playbooks and Terraform for firmware updates and cluster scaling. Manage local S3 connectors and high-speed NVMe (xfs/ext4) scratch storage.
- Build Prometheus/Grafana dashboards with NVIDIA DCGM to monitor InfiniBand links, memory, and rack-level power/thermal limits.
Requirements
- 8–10+ years in enterprise infrastructure, with 3–5+ years hands-on building bare-metal Kubernetes/OpenShift or on-prem HPC/AI clusters.
- Practical experience deploying NVIDIA NIM/NGC and tuning vLLM, Triton, DeepSpeed, or Ray.
- Deep CLI mastery (oc, kubectl) of bare-metal OpenShift and expert RHEL/Ubuntu administration.
- Hands-on experience with NVIDIA Quantum InfiniBand (NDR/XDR), Subnet Managers, and NVMe Software-Defined Storage.
- Certifications (Preferred): Red Hat OpenShift Specialist, CKA/CKS, or NVIDIA Certified Professional (InfiniBand / AI Infrastructure).
(Note: This is an intensive, hardware-facing infrastructure, networking, and systems architecture role)
Apply directly here on LinkedIn or send your CV to [email protected] to start a confidential conversation with us.
AIInfrastructure #BareMetal #OpenShift #NVIDIA #InfiniBand #HPC #PlatformEngineering #PrivateCloud #TechHiringUAE
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Discovered MENA
Workplace Technology Manager (UAE National)
Abu Dhabi, UAE
The employer is seeking a Workplace Technology Manager to lead workplace technology and IT support services in Abu Dhabi. The hands-on role covers service desk operations, incident ownership, end-user support, and servic
Paid Performance Director
, UAE
The employer is seeking a Paid Performance Director to lead paid and digital acquisition across MENA. The role owns a multimillion-dollar media budget, builds a team, and drives measurable growth. Candidates need 10+ yea
Senior Network and Security engineer
, UAE
Discovered MENA is hiring Senior Network and Security Engineers to lead, scale, and secure enterprise and research infrastructure. Applicants need 15+ years of hands-on networking and security operations experience, a re
Recruiter
, UAE
A crypto company is seeking a recruiter to own hiring across corporate support functions, including People, Workplace and administrative roles. The role includes full-cycle recruitment, internship hiring, pipeline develo
Workplace Technology Manager (UAE National)
Abu Dhabi, UAE
Paid Performance Director
, UAE
iOS Developer (4 month Contract)
, UAE
Senior Network and Security engineer
, UAE
Recruiter
, UAE
Principal DevOps engineer
, UAE
Lead Solution Architect
Abu Dhabi, UAE