AI Response Labeler – French Specialty

This is a fully remote position, open to applicants in Peru.

📋 Description

• Conduct side-by-side assessments of AI-generated responses to determine the more effective response

• Analyze responses for accuracy, relevance, completeness, clarity, reasoning, adherence to instructions, tone, and overall quality

• Evaluate content produced in English, French, or a combination of both languages

• Review general-purpose inquiries and answers, web search results, file-based tasks, image-based responses, content generation requests, and both single-turn and multi-turn dialogues

• Leverage French expertise regarding language, terminology, tone, regional conventions, idioms, and cultural context specific to France

• Identify unsupported assertions, incomplete reasoning, overlooked instructions, awkward phrasing, cultural inaccuracies, and variations in usefulness

• Accurately and consistently apply scenario-specific annotation guidelines

• Make independent evaluation judgments on ambiguous cases

• Record decisions and provide succinct, evidence-based justifications

• Fulfill evaluations within designated time and productivity standards while ensuring accuracy

• Engage in training, guided practice, calibration sessions, qualification reviews, and continuous quality review activities

• Integrate feedback and refine decisions to meet team and client quality expectations

• Complete a minimum of 25 evaluation tasks daily within a highly structured, repetitive workflow

⛳️ Requirements

• Native-level or professional proficiency in French

• Extensive knowledge of French linguistic conventions, regional vocabulary, idioms, tone, and cultural context specific to France

• Strong fluency in English along with reading comprehension skills

• Excellent analytical and critical thinking abilities

• Capability to evaluate content across diverse topics, formats, and task types

• Skill in assessing accuracy, relevance, reasoning, clarity, adherence to instructions, cultural appropriateness, and overall usefulness

• Ability to discern subtle distinctions in meaning, quality, tone, and user intent

• Sound judgment in ambiguous or unfamiliar situations

• Strong written communication abilities

• Exceptional attention to detail and accuracy in meeting time expectations

• Capacity to learn and consistently implement detailed evaluation frameworks

• Ability to work autonomously while adhering to shared quality standards

• Comfort in performing repetitive, detail-oriented tasks for extended periods

• Willingness to accept feedback, re-evaluate decisions, and adapt as guidelines change

• Must successfully complete the structured onboarding process and qualification before commencing production work

• Must achieve productivity targets, generally completing at least 25 tasks daily

• Preferred: experience with side-by-side labeling, annotation, comparative content evaluation, quality assessment, AI-generated response evaluation, model quality assessment, data labeling, search relevance, content quality, factual accuracy, user-facing digital experiences, detailed guidelines, rubrics, or structured decision-making frameworks

🏝️ Benefits

• Medical, dental, and vision insurance

• Flexible Spending Account (FSA)

• 401(k) retirement savings plan

• Competitive paid time off policy

• Parental leave

• Opportunities for professional growth and development

• Benefits in accordance with local regulations and employment terms

• Employer of Record assistance for local employment, payroll, and benefits compliance