Financial AI Evaluator (Remote, Hourly Contractor)
Role Overview
In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:
Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles
Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing
Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records
Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks
Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt
Full Job Posting
Position Summary
In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:
Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles
Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing
Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records
Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks
Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt
Profile Requirements
- Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field
- Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management
- Ability to explain complex financial concepts clearly and accurately in writing
- Full professional English proficiency
- Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow
Preferred Experience
Prior experience with AI data training, annotation, or model evaluation
Familiarity with multimodal AI tools or LLM evaluation workflows
About CNTXT AI
CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.
About CNTXT AI
UAE-based Arabic-first AI company helping governments and enterprises build and scale sovereign AI solutions.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at CNTXT AI
Senior QA Engineer
Abu Dhabi, UAE
CNTXT AI is seeking a Senior QA Engineer to test web, mobile, API, and AI-enabled applications, with particular attention to Arabic-language content and interfaces. The role requires five or more years of QA experience,
C++ Coding Expert – AI Training (Remote, Hourly Contractor)
Abu Dhabi, UAE
CNTXT AI seeks a C++ coding expert to evaluate AI-generated code and create prompts and test cases that assess coding accuracy and reasoning. Applicants need modern C++ proficiency, professional English, and strong code-
Arabic/English Bilingual AI Data Annotator & Evaluator (Remote, Hourly Contractor)
Riyadh, KSA
CNTXT AI is seeking an Arabic/English bilingual annotator and evaluator for remote AI language projects on a flexible, project-based hourly contractor basis. Applicants need native or near-native Arabic, C1 English, and
Senior Marketing Executive - Tech
Dubai, UAE
CNTXT AI is seeking a Senior Marketing Executive with technology or AI marketing experience to grow awareness, qualified leads, and adoption of its products. The role combines B2B campaigns, product messaging, content, a
Python Coding Expert – AI Training (Remote, Hourly Contractor)
Abu Dhabi, UAE
CNTXT AI seeks a Python coding expert to evaluate AI-generated code and create prompts and test cases for AI training. The work includes assessing correctness, efficiency, readability, and reasoning quality. Strong Pytho
Partnerships & Operations Lead
, UAE
CNTXT AI seeks a Partnerships & Operations Lead to develop business partnerships and launch and manage egocentric data collection operations. The role combines prospecting, negotiation, partner onboarding, field-site coo
Lead Security Engineer
Abu Dhabi, UAE
CNTXT seeks a hands-on security lead to establish and implement cybersecurity across its applications, cloud infrastructure, endpoints, identity systems, and AI/data products. Candidates need 7–10+ years in security engi
Mobile Application Developer (React Native)
, UAE
CNTXT AI is seeking an experienced mobile developer to build and maintain iOS, Android, React Native, and Unity VR applications and own releases, security, and app health. Applicants need 5+ years of mobile development,
Senior QA Engineer
Abu Dhabi, UAE
C++ Coding Expert – AI Training (Remote, Hourly Contractor)
Abu Dhabi, UAE
Arabic/English Bilingual AI Data Annotator & Evaluator (Remote, Hourly Contractor)
Riyadh, KSA
Senior Marketing Executive - Tech
Dubai, UAE
Python Coding Expert – AI Training (Remote, Hourly Contractor)
Abu Dhabi, UAE
Partnerships & Operations Lead
, UAE
Lead Security Engineer
Abu Dhabi, UAE
Mobile Application Developer (React Native)
, UAE