
AI Content Analyst, Portuguese
Posted 22 hours ago

Posted 22 hours ago
• Develop and execute brief multi-turn dialogues (usually 1–5 turns) aimed at assessing AI personalization capabilities.
• Formulate prompts based on realistic personal situations to measure contextual comprehension.
• Analyze AI replies to ascertain whether personalization has been correctly implemented.
• Evaluate grounding quality to confirm that the model does not create unsupported assertions about the user.
• Assess integration quality by ensuring personal signals are utilized naturally (avoiding forced or robotic responses).
• Compare two responses side-by-side to identify which one is more helpful, natural, and relevant.
• Compose clear, organized rationales that explain rankings and reference specific conversation turns.
• Verify debug information to ensure the correct data sources were utilized.
• Adhere to strict workflow protocols, including the deletion of evaluation conversations when necessary.
• Proficient in Portuguese (both reading and writing are essential) — Portuguese serves as the primary evaluation language.
• Significant experience with Gemini, YouTube, Gmail, and having Personal Intelligence enabled.
• Strong analytical skills and capability to evaluate nuanced AI outputs.
• Exceptional written communication abilities to create structured evaluation notes.
• High attention to detail when analyzing similar responses.
• Capacity to work independently in a fully remote setting.
• Reliable desktop or laptop computer along with a stable internet connection.
• Willingness to utilize your primary personal Google account and enable personal data sources for evaluation purposes.
• Opportunity to work in a dynamic and innovative environment.
• Flexible working hours that support work-life balance.
• Engage in meaningful projects that influence AI personalization.
BJAK
Lokal
Crescendo
Rialtic
Get handpicked remote jobs straight to your inbox weekly.