AI Voice Evaluation Specialist

This is a fully remote position, open to applicants in Alabama, +9 more states.

📋 Description

• Analyze a designated scenario and engage in a natural dialogue with two distinct AI models.

• Conduct parallel conversations with Model A and Model B, ensuring consistency in the scenario, conversational style, and overall interaction.

• Aim to maintain a similar number of conversational turns with each model to facilitate an equitable comparison.

• Capture your voice during each session and carefully monitor the quality and behavior of the model's responses.

• Assess each model across five specified evaluation dimensions.

• Identify and categorize relevant error clusters that may arise in the audio or dialogue.

• Compare the effectiveness of Model A and Model B based on the evaluation metrics and your insights.

• Determine which model exhibited superior overall performance according to the established evaluation criteria.

• Compose a comprehensive rationale outlining your final choice, citing specific examples and observations from both dialogues.

• Consistently apply evaluation guidelines across various scenarios and model interactions.

⛳️ Requirements

• Bachelor's Degree

• Strong attention to detail with the ability to discern subtle variations in conversational quality.

• Excellent listening and comprehension abilities.

• Strong written communication skills, particularly in articulating observations clearly and objectively.

• Capability to consistently adhere to detailed evaluation guidelines.

• Comfort with natural speech and roleplaying various conversational scenarios.

• Ability to fairly compare two interactions without allowing personal biases to impact the evaluation.

• Strong critical thinking and analytical skills.

• Reliability and consistency in completing structured evaluation tasks.

• Familiarity with AI assistants, voice-based AI, or conversational systems.

🏝️ Benefits

• Opportunity to work with cutting-edge AI technology.

• Collaborative and dynamic work environment.

• Professional development and skill enhancement opportunities.