
AI Personalization Rater
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Canada.
• Evaluate responses generated by AI using tailored prompts and data sourced from integrated Google applications.
• Assess the relevance, accuracy, helpfulness, and personalization of these responses.
• Identify instances of incorrect personalization, unsupported assumptions, irrelevant suggestions, and inconsistencies.
• Compare various AI-generated responses and evaluate the overall user experience.
• Deliver clear, detailed, and well-reasoned feedback on evaluations.
• Adhere to project guidelines to ensure consistent and high-quality ratings.
• Recognize subtle strengths and weaknesses within AI-generated responses.
• Uphold data privacy and comply with the confidentiality requirements of the project.
• Must be currently residing in Canada.
• Willing and able to connect relevant Google applications to Gemini, pending required permissions and consent.
• Active experience with Google Workspace or consumer Google apps, possessing sufficient personal data or history for personalized retrieval evaluations.
• Strong analytical skills and meticulous attention to detail.
• Excellent command of written English and capacity to provide structured feedback.
• Ability to work autonomously in a remote setting.
• Access to a desktop or laptop with a stable internet connection.
• Bachelor’s degree or equivalent practical experience in any field.
• Opportunity to work remotely and independently.
• Engage in a project that values accuracy and user experience.
• Contribute to the advancement of AI technology.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.