Data Quality & AI Operations Manager
Role Overview
Own content and data operations for Extend's platform, improve profiling accuracy, and use AI fine-tuning to progressively automate manual annotation.
Own the evaluation and data feedback loop and lead the content operations team.
Success is measured by golden-set accuracy and profile automation rate.
Key Skills for This Role
Full Job Posting
About Extend
Extend is a Saudi cultural intelligence and advertising company serving brands and institutions across experiences, media, and publishing.
Extend is building Extend CIP, a cultural intelligence platform for planning, managing, and measuring paid and earned media, media and influencer buying, and brand monitoring.
Role summary
Own content and data operations for Extend's platform, improve profiling accuracy, and use AI fine-tuning to progressively automate manual annotation.
Own the evaluation and data feedback loop and lead the content operations team.
Success is measured by golden-set accuracy and profile automation rate.
What you'll do
- Build and maintain golden sets and evaluation suites; define acceptance criteria for each AI Admin iteration.
- Curate training and evaluation data, run benchmarks, analyze failure modes, and partner with Shanghai engineering on fine-tuning and deployment.
- Design human-in-the-loop review and auto-approval boundaries, and feed human corrections into prompts, evaluation sets, and training data.
- Write and maintain Arabic and English labeling guidelines; adjudicate culturally or linguistically sensitive edge cases.
- Lead annotation operations, including rater training, workflows, throughput, and quality SLAs.
- Track accuracy, automation rate, inter-annotator agreement, cost, and turnaround per profile.
What we're looking for
- Fluent Arabic and strong knowledge of Arab-world media, brands, publishers, and cultural context.
- Hands-on AI agent or LLM experience, including evaluation design, golden sets, and model feedback loops; familiarity with SFT, RLHF, and prompt iteration.
- At least 2 years in AI data operations or applied AI quality in a data-labeling company, in-house annotation team, or AI product team.
- Comfort collaborating across Riyadh and Shanghai time zones.
Nice to have
- LLM-assisted labeling automation, taxonomy design, or social or media data experience.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at extend
شريك المسوقين (Marketers Advocate)
Riyadh, KSA
تبحث إكستند عن شريك للمسوقين لتمثيل منصتها وتدريب العملاء وصناعة محتوى عملي للمسوقين. يتطلب الدور خبرة لا تقل عن خمس سنوات في التسويق بالأداء في السوق السعودي، ومعرفة بمنصات الإعلان وكتابة عربية واضحة واستعدادًا للسفر با
Business Development Manager
Riyadh, KSA
Extend is hiring a founding sales seat for its Cultural Intelligence Platform (CIP) in Saudi Arabia. You will own the full net-new acquisition cycle from prospecting to funded deposit and first live campaign, building th