Quality Analyst (Remote)
Role Overview
This full-time remote role evaluates a personalization feature for an AI model.
The analyst assesses how the model integrates information from conversations, email, search, and activity to produce relevant responses.
The work combines creative prompt design with analytical evaluation of AI-generated content.
Key Skills for This Role
Full Job Posting
Role Overview
This full-time remote role evaluates a personalization feature for an AI model.
The analyst assesses how the model integrates information from conversations, email, search, and activity to produce relevant responses.
The work combines creative prompt design with analytical evaluation of AI-generated content.
Responsibilities
- Evaluate personalized AI responses using personal experiences as context.
- Design multi-turn prompts that test accurate integration of personal data sources.
- Assess responses for grounding, integration, helpfulness, relevance, and accuracy.
- Identify incorrect personalization, forced connections, and subtle output discrepancies.
- Provide detailed feedback on model behavior to improve personalization performance.
Required Qualifications
- Demonstrate high competence in reading and writing English.
- Have experience in prompt engineering or designing AI model test cases.
- Analyze nuanced and ambiguous AI responses with analytical rigor.
- Be familiar with personalization concepts and AI evaluation metrics.
- Have strong attention to detail when identifying subtle discrepancies in model outputs.
- Be willing to use a primary personal Google account and enable personal data sources for assessment.
- Be available full-time in the local time zone for a global 24-hour operations team.
Workplace
- The role is remote and described as work from anywhere.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hired
Mechanical Engineer (Remote)
, UAE
The client seeks an engineering expert to design scalable architectures, resolve complex production issues, and establish engineering standards for distributed systems and backend infrastructure. Candidates need experien
Computational Biologist (Remote)
, UAE
Hired is seeking a full-time Computational Biologist to develop computational models and algorithms for biological data in collaboration with cross-functional teams. The role requires a PhD in computational biology, bioi
Corporate Finance Analyst (Remote)
, UAE
The employer is seeking a Corporate Finance Analyst to evaluate financial risks, optimize capital allocation, and support strategic decisions. The role includes financial modeling, reporting, valuation, M&A support, and
Lawyer (Remote)
, UAE
The employer is seeking a Lawyer on a contract basis to provide legal advice and services across multiple jurisdictions. The role focuses on contracts, corporate governance, regulatory compliance, legal research, dispute
Physics Expert (Remote)
, UAE
A client of Hired is seeking a Physics Expert to develop and refine computational models for high-precision simulations. The role focuses on quantum mechanics, electromagnetism, statistical physics, experimental data ana
Talent Acquisition Specialist (Remote)
, UAE
The employer is seeking a Talent Acquisition Specialist to source, engage, screen, and coordinate candidates while supporting full-cycle recruiting and onboarding. The role requires ATS experience, sourcing knowledge, st
Data Entry Clerk (Remote)
, UAE
The employer is seeking a remote Data Entry Clerk to transcribe, verify, organize, and securely maintain business data. Candidates must type at least 40 words per minute, use spreadsheet software, protect sensitive infor
Biology Specialist (Remote)
, UAE
The employer is seeking a Biology Expert with a PhD to support biological research and analysis on a specific project. The role includes experimental design, data analysis, scientific reporting, and regulatory compliance
Mechanical Engineer (Remote)
, UAE
Computational Biologist (Remote)
, UAE
Corporate Finance Analyst (Remote)
, UAE
Lawyer (Remote)
, UAE
Physics Expert (Remote)
, UAE
Talent Acquisition Specialist (Remote)
, UAE
Data Entry Clerk (Remote)
, UAE
Biology Specialist (Remote)
, UAE