Labeler, Annotator – AI Response Evaluation, Italian

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Conduct side-by-side (SBS) assessments of AI-generated outputs.

• Evaluate results based on:

• Accuracy

• Relevance

• Clarity

• Adherence to instructions

• Recognize subtleties in tone, meaning, and cultural context in Italian.

• Implement detailed, scenario-specific annotation guidelines.

• Ensure consistency and uphold high-quality evaluations.

⛳️ Requirements

• Native or professional fluency in Italian.

• Strong reading comprehension in English (necessary for understanding guidelines).

• Previous experience with side-by-side (SBS) labeling or annotation.

• Exceptional analytical skills and meticulous attention to detail.

• Capacity to swiftly grasp and apply structured evaluation frameworks.

🏝️ Benefits

• Statutory benefits (e.g., paid leave, 13th salary where applicable).

• Contributions to social security and healthcare.

• Additional benefits in line with local market practices.