AI Evaluation & Annotation Reviewer, L3 – Advanced Level – Portuguese

Posted Jul 23

This is a fully remote position, open to applicants in Brazil, +3 more countries.

πŸ“‹ Description

β€’ Evaluate AI-generated responses for clarity, precision, correctness, relevance, and overall quality.

β€’ Annotate and categorize language content following comprehensive project guidelines.

β€’ Create or assess prompts in accordance with assignment specifications.

β€’ Detect linguistic mistakes, dataset issues, and structural discrepancies.

β€’ Offer clear, organized feedback to facilitate enhancements in AI performance.

β€’ Articulate complex language requirements effectively to both linguistic and non-linguistic stakeholders.

β€’ Work in collaboration with QA Leads and clients to implement feedback and uphold quality standards.

β€’ Attend necessary client-facing meetings with your camera enabled.

β€’ Provide daily work reports and consistently achieve productivity and quality benchmarks.


⛳️ Requirements

β€’ Professional fluency in **Portuguese** with excellent written and verbal communication abilities.

β€’ A bachelor’s degree in Linguistics, Languages, Computer Science, or a related discipline, or equivalent professional experience.

β€’ **A degree or certification in** **Portuguese, where applicable.**

β€’ Strong analytical capabilities and remarkable attention to detail.

β€’ The ability to recognize patterns, errors, inconsistencies, and subtle language nuances.

β€’ Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is advantageous but not mandatory.

β€’ A keen interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.

β€’ Capability to learn new tools, adhere to detailed guidelines, and adjust to evolving project requirements.

β€’ Strong organizational and task management skills.

β€’ Professional communication skills and confidence in participating in client-facing meetings.

β€’ Ability to work independently and collaborate effectively within a global team.


🏝️ Benefits

β€’ Opportunity to work with cutting-edge AI technology.

β€’ Flexible work environment with options for remote work.

β€’ Collaborative team culture focused on professional growth.

β€’ Access to ongoing training and development opportunities.

People also viewed

LGC15 hours ago

AI Delivery Lead

HU flagHungary OnlyFull-timeArtificial Intelligence
ApplyView job
Mercor16 hours ago

AI Safety Red Teamer

US flagUnited States OnlyFreelanceArtificial Intelligence$70 – $84/hour
ApplyView job
Mercor16 hours ago

AI Safety Red Teamer

US flagUnited States OnlyFreelanceArtificial Intelligence$70 – $84/hour
ApplyView job
Triple Whale 🐳17 hours ago

AI Marketing Strategist

US flagUnited States OnlyFull-timeArtificial Intelligence
ApplyView job
The Cigna Group17 hours ago

Data Measurement & Reporting, Digital Data & AI

US flagNew Jersey OnlyFull-timeArtificial Intelligence$96.7k – $161.1k/year
ApplyView job
U.S. Digital Response18 hours ago

Chief Technology, AI Officer

US flagUnited States OnlyFull-timeArtificial Intelligence$250k – $277.5k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers