Labeler / Annotator – AI Response Evaluation, Italian

This is a fully remote position, open to applicants in Latin America.

📋 Description

• Conduct side-by-side (SBS) evaluations of AI-generated outputs.

• Assess results based on:

• Precision

• Pertinence

• Coherence

• Adherence to instructions

• Recognize subtle differences in tone, meaning, and cultural context in Italian.

• Implement specific annotation guidelines tailored to various scenarios.

• Uphold consistency and deliver high-quality evaluations.

⛳️ Requirements

• Native or proficient fluency in Italian.

• Strong reading comprehension in English (necessary for understanding guidelines).

• Previous experience with side-by-side (SBS) labeling or annotation.

• Exceptional analytical skills and meticulous attention to detail.

• Capacity to swiftly grasp and apply structured evaluation frameworks.

🏝️ Benefits

• Statutory benefits (e.g., paid vacation and aguinaldo / Sueldo Anual Complementario (SAC)).

• Contributions to social security and healthcare coverage (Obra Social).

• Additional benefits that align with local market standards.