AI Fact-Checking, Response Evaluation Reviewer – French

This is a fully remote position, open to applicants in France.

📋 Description

• Utilize independent judgment to identify AI blind spots, reasoning failures, factual inaccuracies, contradictory evidence, and quality gaps.

• Review and assess AI-generated responses in French.

• Validate factual claims using credible online sources and supporting evidence.

• Evaluate whether the evidence supports, contradicts, or fails to substantiate AI-generated conclusions.

• Assess response quality, relevance, completeness, and alignment with user intent.

• Identify inconsistencies, unsupported claims, contradictory information, and missing evidence.

• Challenge AI-generated conclusions when the evidence indicates a different outcome.

• Provide clear quality feedback and rationale for review decisions.

• Engage in training, calibration, and quality alignment sessions conducted in English.

• Uphold quality, consistency, commitment, and productivity standards while fulfilling project requirements.

• Collaborate with project teams to enhance reviewer standards and AI quality outcomes.

• Complete guideline reviews, platform training, UI navigation exercises, knowledge assessments, fact-checking exercises, and project simulation tasks as part of the qualification process.

⛳️ Requirements

• Native or near-native proficiency in French.

• Strong English skills, including the ability to comprehend guidelines and participate in training sessions.

• Prior experience in Fact-Checking, Quality Assurance, Content Review, Search Evaluation, Annotation Review, Trust & Safety, Data Quality, Linguistic QA, Research Analysis, or similar analytical roles.

• Excellent critical-thinking and analytical capabilities.

• Strong evidence-based decision-making skills.

• High attention to detail and consistency.

• Ability to independently assess and question AI-generated conclusions.

• Capability to differentiate between factual support, contradiction, and lack of evidence.

• Proficient in interpreting complex queries and accurately evaluating response quality.

• Comfortable working with structured data and projects related to AI.

• Able to navigate ambiguity and incomplete information effectively.

• Must pass a qualification assessment in English/French.

• Experience in reviewing AI training data or annotation projects.

• Familiarity with Response Evaluation, Search Quality Rating, RLHF, LLM evaluation, AI model assessment, or human-in-the-loop review workflows.

• Background in Fact-Checking, Trust & Safety, Information Verification, or Online Research.

• Experience in journalism, research, education, editorial review, investigation, or content quality assessment.

• Demonstrated experience providing quality feedback, coaching, or calibration support to reviewer teams.

• Experience handling time-sensitive content such as news, public information, sports, finance, or search-related material.

🏝️ Benefits

• Fully remote and flexible working environment.

• Compensation in USD.

• Opportunity to work on innovative AI and language technologies.

• Collaborate with a global network of AI quality professionals.

• Long-term opportunities available for high-performing contributors.

• Potential career advancement into specialized roles in AI Quality, Fact-Checking, and Quality Control.

• Contribute to shaping how AI systems evaluate information and make decisions.

• Play a direct role in developing safer, more reliable, and trustworthy AI systems.