Quality Evaluator, Fluent English

This is a fully remote position, open to applicants in Argentina.

📋 Description

• Engage with a variety of AI models and tools across diverse prompts and subjects.

• Conduct side-by-side comparisons of multiple AI-generated responses.

• Evaluate accuracy, helpfulness, adherence to instructions, clarity, and overall quality of responses.

• Adhere to comprehensive rating guidelines and follow multi-step evaluation processes.

• Compose clear and well-reasoned explanations to support evaluation decisions.

• Consistently apply evaluation criteria across different tasks.

⛳️ Requirements

• Proficiency in English, with strong reading comprehension and writing abilities.

• Significant hands-on experience with LLMs and the critical assessment of their outputs.

• Strong analytical judgment with the capability to evaluate various aspects of response quality.

• Exceptional attention to detail and the ability to meticulously follow complex instructions.

• Ability to articulate evaluation decisions clearly and persuasively.

• Comfort with navigating between different AI models, tools, and multi-step workflows.

• Previous experience in AI response evaluation, data annotation, or quality assurance (preferable).

• Experience in editing, research, fact-checking, or analytical writing (preferable).

• Familiarity with evaluation rubrics and tasks involving side-by-side comparisons (preferable).

🏝️ Benefits

• Opportunity for remote work.

• Flexible part-time schedule.

• Independent contractor arrangement.

• Commitment of up to 3 months.