AI Response Labeler – French Specialty

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Conduct side-by-side evaluations of AI-generated responses to identify the stronger option.

• Assess responses for factual correctness, relevance, completeness, clarity, reasoning, adherence to instructions, tone, and overall quality.

• Review content written in English, French, or a combination of both languages.

• Analyze general-purpose questions and answers, web-search results, file-based tasks, image-based responses, content generation requests, as well as single-turn and multi-turn conversations.

• Utilize French expertise in language, terminology, tone, regional conventions, idioms, and the cultural context specific to France.

• Detect unsupported claims, incomplete reasoning, overlooked instructions, awkward phrasing, cultural inaccuracies, and variations in usefulness.

• Accurately and consistently apply detailed, scenario-specific annotation guidelines.

• Make independent evaluation choices and provide concise, evidence-based justifications.

• Complete evaluations within established time and productivity standards while ensuring accuracy.

• Maintain consistent judgment across a high volume of diverse assignments.

• Engage in training, guided practice, calibration sessions, qualification reviews, and ongoing quality review activities.

• Integrate feedback and modify decisions to meet team and client quality standards.

• Generally accomplish at least 25 evaluation tasks daily, with most tasks taking approximately 15 minutes.

⛳️ Requirements

• Native-level or professional fluency in French is required.

• In-depth knowledge of French linguistic conventions, regional vocabulary, idioms, tone, and cultural context relevant to France.

• Strong fluency in English and proficient reading comprehension.

• Excellent analytical and critical-thinking skills.

• Capability to evaluate content across various topics, formats, and task types.

• Proficiency in assessing factuality, relevance, reasoning, clarity, adherence to instructions, cultural appropriateness, and overall usefulness.

• Ability to discern subtle differences in meaning, quality, tone, and user intent.

• Sound judgment in ambiguous or unfamiliar situations.

• Strong written communication abilities.

• Exceptional attention to detail and proficiency in maintaining accuracy within time constraints.

• Capability to learn and consistently apply detailed evaluation frameworks.

• Ability to work independently while adhering to shared quality standards.

• Comfort with performing repetitive, detail-oriented tasks for extended periods.

• Ability to accept feedback, recalibrate decisions, and adapt as guidelines change.

• Must successfully complete structured onboarding and qualification prior to commencing production work.

• Preferred: experience with side-by-side labeling, annotation, comparative content evaluation, quality assessment, evaluation of AI-generated responses, model quality assessment, data labeling, search relevance, content quality, factual accuracy, user-facing digital experiences, and structured decision-making frameworks.

🏝️ Benefits

• Medical, dental, and vision insurance coverage.

• Flexible Spending Account (FSA) options.

• 401(k) retirement plan.

• Competitive paid time off.

• Parental leave benefits.

• Opportunities for professional growth and development.

• Employer of Record support for local employment, payroll, and benefits compliance.

• Benefits in accordance with local requirements and employment terms.