Quality Evaluator, English

This is a fully remote position, open to applicants in Argentina.

📋 Description

• Engage with various AI models and tools across a diverse array of prompts and subjects.

• Conduct side-by-side comparisons of two or more AI-generated responses.

• Evaluate accuracy, usefulness, adherence to instructions, clarity, and the overall quality of responses.

• Adhere to comprehensive rating guidelines and multi-step evaluation processes.

• Craft clear and well-reasoned explanations to support evaluation outcomes.

• Consistently apply evaluation criteria across different tasks.

⛳️ Requirements

• Proficiency in English, with strong reading comprehension and writing abilities.

• Significant hands-on experience utilizing LLMs and critically evaluating their outputs.

• Strong analytical skills and the capability to assess multiple aspects of response quality.

• Exceptional attention to detail and the ability to meticulously follow complex instructions.

• Capacity to articulate evaluation decisions clearly and convincingly.

• Comfort in transitioning between AI models, tools, and multi-step processes.

• Prior experience in AI response evaluation, data annotation, or quality assurance is a plus.

• Background in editing, research, fact-checking, or analytical writing is advantageous.

• Familiarity with evaluation rubrics and performing side-by-side comparison tasks is beneficial.

🏝️ Benefits

• Opportunity for remote work.

• Flexible part-time schedule.

• Independent contractor arrangement.

• Commitment duration of up to 3 months.