Multilingual Audio Evaluator

This is a fully remote position, open to applicants in Argentina, +7 more countries.

📋 Description

• Prepare and verify the necessary tools and access prior to each live session.

• Facilitate live, real-time roleplay scenarios utilizing conversational AI agents.

• Record and document session IDs, tool calls, and console logs.

• Categorize conversation transcripts in accordance with project standards.

• Evaluate interactions using structured assessment rubrics.

• Offer clear written justifications that support the assigned scores.

• Read, assess, and troubleshoot JSON, pinpointing structural and formatting discrepancies.

• Assist in enhancing the quality and dependability of AI conversations across different languages.

⛳️ Requirements

• C1/C2 spoken fluency in at least one target language: Welsh, Dutch, Greek, Italian, French, German, or Portuguese.

• Capability to demonstrate language proficiency through a speaking and listening evaluation.

• Proficient in JSON, including reading, validating, troubleshooting, and recognizing structural or formatting issues.

• Comfortable with digital tools for collecting recordings and technical logs.

• Strong attention to detail and the ability to consistently adhere to evaluation guidelines.

• Clear written communication skills and sound judgment in assessing AI interactions.

• Eligibility for location is subject to project location constraints.

• Experience in AI evaluation, audio annotation, or transcript labeling is a plus.

• Background in technical support, quality assurance, or software development is advantageous.

• Familiarity with conversational AI, APIs, and structured data is beneficial.

🏝️ Benefits

• Independent contractor / Project-based.

• Remote work opportunity.

• Project duration of 2–3 months.