AI Voice Evaluation Specialist

atInnoDataRemoteCA flagCanadaFull-timeArtificial IntelligenceMid-levelSeniorC$20 – C$25/hour

Posted 3 days ago

This is a fully remote position, open to applicants in Canada.

📋 Description

• Assess a designated scenario and engage in a natural dialogue using two distinct AI models.

• Execute similar conversations with Model A and Model B, ensuring the scenario, conversational style, and overall engagement remain as uniform as possible.

• Aim to maintain a comparable number of conversational exchanges with each model to facilitate an equitable assessment.

• Record your voice throughout each interaction, paying close attention to the quality and behavior of the models' responses.

• Evaluate each model based on five specified evaluation dimensions.

• Identify and classify relevant error patterns that may emerge in the audio or dialogue.

• Analyze the performance of Model A and Model B according to the evaluation criteria and your observations.

• Choose the model that exhibited superior overall performance based on the established evaluation framework.

• Prepare a comprehensive rationale detailing the final choice, citing specific examples and observations from both dialogues.

• Consistently apply evaluation guidelines across various scenarios and model interactions.


⛳️ Requirements

• Bachelor’s degree.

• Exceptional attention to detail and an ability to discern subtle variations in conversational quality.

• Outstanding listening and comprehension capabilities.

• Strong writing skills, particularly in articulating observations clearly and objectively.

• Capability to consistently adhere to detailed evaluation guidelines.

• Comfort in speaking naturally and role-playing various conversational situations.

• Ability to objectively compare two interactions without letting personal biases affect the evaluation.

• Strong critical-thinking and analytical abilities.

• Reliability and consistency in completing structured evaluation assignments.

• Familiarity with AI assistants, voice-based AI, or conversational systems.


🏝️ Benefits

• W2 full-time contract employment.

• 40 hours per week.

People also viewed

CVS Health Careers10 hours ago

Senior Analyst, Clinical AI and Data Strategy

US flagTexas OnlyFull-timeArtificial Intelligence$47k – $102k/year
ApplyView job
Sourcegraph10 hours ago

AI Transformation Architect

US flagUnited States OnlyFull-timeArtificial Intelligence$200k/year
ApplyView job
MCA Connect10 hours ago

Senior Consultant, Data & AI – Microsoft

US flagUnited States OnlyFull-timeArtificial Intelligence$120k – $145k/year
ApplyView job
Lightly10 hours ago

AI Operations Monitor – Digital Operations & Incident Response

CH flagSwitzerland OnlyFreelanceArtificial Intelligence$20 – $30/hour
ApplyView job
WRS Health10 hours ago

AI & Automation Marketing Lead

US flagUnited States OnlyFreelanceArtificial Intelligence
ApplyView job
WRS Health10 hours ago

AI and Automation Marketing Lead

US flagUnited States OnlyFreelanceArtificial Intelligence
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers