Portuguese Audio Evaluations Specialist – Freelance AI Trainer

This is a fully remote position, open to applicants in United States.

📋 Description

• Function independently to create intricate evaluation frameworks and supply organized training data.

• Role-Play Scenario Execution: Developing and implementing sophisticated, role-play-driven evaluation scenarios that replicate authentic customer service interactions across travel, finance, and technical support sectors.

• Model Performance Auditing: Assessing the performance of AI models based on standardized qualitative and quantitative metrics, with a focus on task completion accuracy, conversational fluidity, and audio comprehension.

• Technical Metric Evaluation: Evaluating the model's foundational computer programming knowledge, including its grasp of JSON structures, functions, methods, and its capability to reason about structured data within a support framework.

• Representative Dataset Generation: Assisting in the creation of varied, high-quality audio datasets that genuinely reflect real customer expectations for clarity, efficiency, and natural conversational flow.

⛳️ Requirements

• Proven professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.

• Native or bilingual fluency in the target language, encompassing proficiency in all language skills (reading, listening, writing, and speaking), along with strong analytical and verbal communication capabilities to effectively conduct simulated customer support role-plays.

• Basic understanding of computer programming, particularly a comfortable familiarity with JSON structures, functions, methods, and simple logic.

• A careful, detail-oriented mindset when working with structured prompts, complex evaluation rubrics, and technical guidelines.

• Access to a high-quality microphone to guarantee clear, reliable audio input during voice evaluations.

🏝️ Benefits

• Health insurance and PTO do not apply.