Labeler, Annotator – AI Response Evaluation, German

This is a fully remote position, open to applicants in Latin America.

📋 Description

• Assess AI responses in various contexts, including general-purpose Q&A, web search outcomes, file and image responses, image and file generation tasks, along with single-turn and multi-turn dialogues.

• Conduct side-by-side (SBS) evaluations of AI-generated outputs.

• Analyze responses based on criteria such as accuracy, relevance, clarity, and adherence to instructions.

• Recognize subtleties in tone, meaning, and cultural context within the German language.

• Implement detailed annotation guidelines tailored to specific scenarios.

• Ensure consistency and deliver high-quality evaluations.

⛳️ Requirements

• Native or professional proficiency in German.

• Strong reading comprehension skills in English (essential for understanding guidelines).

• Previous experience in side-by-side (SBS) labeling or annotation.

• Exceptional analytical skills and keen attention to detail.

• Capability to swiftly grasp and utilize structured evaluation frameworks.

🏝️ Benefits

• Statutory benefits (e.g., paid leave, 13th salary where applicable).

• Contributions to social security and healthcare.

• Additional benefits that align with local market standards.