
AI Evaluation & Annotation Reviewer, L3 – Advanced Level, Italian
Posted Jul 29

Posted Jul 29
This is a fully remote position, open to applicants in Canada.
• Assess AI-generated responses for clarity, accuracy, relevance, correctness, and overall quality.
• Annotate and categorize language content in accordance with specific project guidelines.
• Create or evaluate prompts based on the requirements of the assignment.
• Detect linguistic errors, dataset issues, and structural inconsistencies.
• Offer clear, structured feedback to facilitate enhancements in AI performance.
• Clearly communicate complex language requirements to both linguistic and non-linguistic stakeholders.
• Work collaboratively with QA Leads and clients to implement feedback and uphold quality standards.
• Engage in mandatory client-facing meetings with your camera on.
• Provide daily work reports and consistently adhere to productivity and quality standards.
• Professional fluency in **Italian** with strong written and verbal communication abilities.
• A bachelor’s degree in Linguistics, Languages, Computer Science, or a related discipline, or equivalent professional experience.
• **A degree or certification in Italian, when applicable.**
• Strong analytical skills and remarkable attention to detail.
• Ability to recognize patterns, errors, inconsistencies, and nuanced language issues.
• Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is beneficial but not mandatory.
• A keen interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
• Capability to learn new tools, adhere to detailed guidelines, and adjust to evolving project requirements.
• Exceptional organization and task management skills.
• Professional communication skills and confidence in participating in client-facing meetings.
• Ability to work independently while effectively collaborating with a global team.
• Competitive salary and comprehensive benefits package.
• Opportunities for professional development and career advancement.
• Flexible working hours and a supportive remote work environment.
• Access to cutting-edge technology and innovative projects.
CVS Health
One Impression
Volga Partners
Mercor
Get handpicked remote jobs straight to your inbox weekly.