
AI Evaluation & Annotation Reviewer, Italian
Posted Jul 23

Posted Jul 23
This is a fully remote position, open to applicants in Italy, +2 more countries.
• Evaluate AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
• Annotate and label language content in accordance with comprehensive project guidelines.
• Create or assess prompts based on specific assignment criteria.
• Detect linguistic errors, dataset issues, and structural inconsistencies.
• Offer clear, structured feedback to facilitate enhancements in AI performance.
• Convey complex language requirements effectively to both linguistic and non-linguistic stakeholders.
• Collaborate with QA Leads and clients to implement feedback and uphold quality standards.
• Engage in necessary client-facing meetings with your camera activated.
• Submit daily work reports and consistently achieve productivity and quality benchmarks.
• Professional fluency in **Italian** with strong written and verbal communication abilities.
• A bachelor's degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
• **A degree or certification in Italian, where applicable.**
• Strong analytical capabilities and exceptional attention to detail.
• The capacity to recognize patterns, errors, inconsistencies, and subtle language nuances.
• Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is beneficial but not mandatory.
• A keen interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
• The ability to master new tools, adhere to detailed guidelines, and adapt to evolving project demands.
• Strong organizational and task-management skills.
• Professional communication abilities and confidence in participating in client-facing meetings.
• The capability to work autonomously and collaborate effectively within a global team.
• Competitive salary and performance-based incentives.
• Opportunities for professional growth and development.
• Flexible working hours and the option for remote work.
• A collaborative and inclusive work environment.
• Access to the latest tools and technologies in the field.
Mercor
Mercor
Triple Whale 🐳
Get handpicked remote jobs straight to your inbox weekly.