Labeler, Annotator – AI Response Evaluation, Japanese

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Conduct side-by-side (SBS) evaluations of AI-generated outputs.

• Assess responses based on:

• Accuracy

• Relevance

• Clarity

• Adherence to instructions

• Recognize subtle differences in tone, meaning, and cultural context in Japanese.

• Utilize specific, detailed annotation guidelines tailored to various scenarios.

• Ensure consistency and uphold high standards in evaluations.

⛳️ Requirements

• Native or professional proficiency in Japanese.

• Strong reading comprehension in English (necessary for understanding guidelines).

• Previous experience with side-by-side (SBS) labeling or annotation.

• Exceptional analytical thinking and meticulous attention to detail.

• Capacity to swiftly grasp and implement structured evaluation frameworks.

🏝️ Benefits

• Statutory benefits (e.g., paid leave, 13th month salary where applicable).

• Contributions to social security and healthcare.

• Additional benefits that align with local market standards.