Writing Assessor (Remote)
Full Job Posting
- Role
Title: Educator And Assessor Writer
- Role Type
: Contractor
- Location
: Remote
Educator/ Assessor Writers to contribute expertise on a customer project focused on advanced AI system development.
In this role, you'll apply your expertise to help train next-generation AI systems.
Your work will shape how models learn, reason, and perform through high-quality, real-world input.
No prior experience in AI is required — your domain knowledge is what matters.
This opportunity is ideal for individuals experienced in evaluating written work against a rubric, examining academic writing, or designing effective assessments.
The engagement is fully remote and offers the flexibility to participate alongside other professional obligations.
Scope of Work
Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
Assign analytical quality scores based on provided rubrics and guidelines.
Compose detailed written rationales justifying each assessment or score.
Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
Document findings meticulously and maintain thorough records of decisions and observations.
Collaborate asynchronously with project managers and reviewers using digital content review platforms.
Preferred Qualifications
First-language proficiency or fully equivalent fluency in written English.
Completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
Experience
marking, grading, or examining written work against set criteria or rubrics.
Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.
Keen attention to detail, critical analysis skills, and the ability to deliver objective, well-articulated judgments.
Capable of independent remote work and meeting project deadlines.
Experience
with model evaluation, RLHF, or annotation is an asset but not mandatory.
What You’ll Do
Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
Assign analytical quality scores based on provided rubrics and guidelines.
Compose detailed written rationales justifying each assessment or score.
Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
Document findings meticulously and maintain thorough records of decisions and observations.
Apply Now!
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Joblet-AI
Radiology Resident Reviewer (Remote)
, UAE
The employer is seeking current radiology residents to support a paid clinical image interpretation benchmarking project. You will review de-identified images and clinical cases, then record diagnostic assessments using
Radiology Image Reviewer (Remote)
, UAE
The employer seeks experienced radiologists and medical imaging specialists to review clinical cases and create reference evaluations for diagnostic AI benchmarks. The work involves interpreting de-identified scans acros
Medical AI Evaluator (Remote)
, UAE
The employer seeks a licensed physician in active clinical practice to help evaluate and improve clinical reasoning in medical AI systems. The work includes designing evaluation frameworks, creating clinical scenarios, a
Technology Transactions Attorney (Remote)
, UAE
The employer seeks an experienced attorney to assess and improve AI systems used for legal contract review. Candidates need at least three years of in-house technology-transactions experience, including negotiation of MS
Commercial Counsel (Remote)
, UAE
The employer seeks an experienced in-house lawyer focused on technology transactions to support legal AI training and evaluation. You will perform contract negotiations and redlining, assess AI outputs, develop evaluatio
Junior Transactional Attorney (Remote)
, UAE
The employer seeks an early-career transactional attorney to help train and evaluate legal AI, with a focus on technology-related contracts. The work includes simulated negotiations and redlining, reviewing AI responses,
Competitive Programmer (Remote)
, UAE
Joblet-AI is seeking competitive programmers to solve coding, logic, debugging, and technical reasoning challenges for an AI training project. Applicants must have a Codeforces profile and strong algorithmic skills, incl
Legal Analyst (Remote)
, UAE
Joblet-AI is seeking legal practitioners to create and evaluate legal content for AI training and model development. The work includes drafting legal prompts, reviewing legal materials and AI outputs, and producing legal
Radiology Resident Reviewer (Remote)
, UAE
Radiology Image Reviewer (Remote)
, UAE
Medical AI Evaluator (Remote)
, UAE
Technology Transactions Attorney (Remote)
, UAE
Commercial Counsel (Remote)
, UAE
Junior Transactional Attorney (Remote)
, UAE
Competitive Programmer (Remote)
, UAE
Legal Analyst (Remote)
, UAE