
AI Evaluation and Annotation Reviewer, Advanced Level – Italian
Posted Aug 29

Posted Aug 29
This is a fully remote position, open to applicants in United States.
• Evaluate AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
• Annotate and label linguistic content according to comprehensive project guidelines.
• Create or assess prompts based on assignment specifications.
• Detect linguistic errors, dataset issues, and structural discrepancies.
• Offer clear and structured feedback to facilitate enhancements in AI performance.
• Convey complex language requirements effectively to both linguistic and non-linguistic stakeholders.
• Work in collaboration with QA Leads and clients to implement feedback and uphold quality standards.
• Engage in necessary client-facing meetings with the camera on.
• Submit daily work reports while consistently achieving productivity and quality benchmarks.
• Professional fluency in Italian with strong written and verbal communication capabilities.
• At least 8 years of experience in Localization, AI Training, or a related area.
• A bachelor's degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
• A degree or certification in Italian, where necessary.
• Strong analytical abilities and exceptional attention to detail.
• Proficiency in identifying patterns, errors, inconsistencies, and subtle language issues.
• Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is advantageous but not mandatory.
• Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
• Capability to learn new tools, adhere to detailed guidelines, and adjust to evolving project requirements.
• Strong organizational and task-management skills.
• Professional communication skills and confidence in participating in client-facing meetings.
• Ability to work autonomously and collaborate effectively with a global team.
• Commitment to the project for a minimum of six months.
• Consistent availability throughout the engagement.
• Work consecutive eight-hour shifts.
• Be available during the required core hours of 8:00 AM–5:00 PM PST.
• Attend daily client meetings scheduled between 10:00 AM–12:00 PM PST.
• Consistently meet attendance, productivity, quality, and reporting expectations.
• Only approved and properly logged hours will be compensated.
• Independent contractor engagement.
• Applicants must not currently reside in Argentina, Bolivia, Brazil, Chile, China, Colombia, Cuba, Ecuador, Iran, Iraq, North Korea, Mexico, Panama, Russia, Sudan, Syria, Ukraine (Crimea, Luhansk, Donetsk), United Kingdom, or Venezuela.
• Acquire practical experience while working on a global Artificial Intelligence project.
• Develop valuable skills in AI evaluation, annotation, prompt review, and language quality.
• Collaborate directly with QA Leads, international teams, and client stakeholders.
• Enhance your experience for future opportunities in AI, language technology, localization, research, and quality assurance.
• Receive project-specific training, guidance, and ongoing feedback.
Mercor
Mercor
Triple Whale 🐳
Get handpicked remote jobs straight to your inbox weekly.