AI Content Analyst, Russian Language

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design and conduct brief multi-turn conversations (usually ranging from 1 to 5 turns) aimed at assessing AI personalization behavior.

• Develop prompts based on realistic personal scenarios to test contextual comprehension.

• Analyze AI responses to ascertain if personalization is effectively implemented.

• Assess grounding quality to ensure the model refrains from fabricating unsupported claims regarding the user.

• Evaluate integration quality — ensuring personal signals are utilized naturally without appearing forced or mechanical.

• Compare two responses side-by-side to identify which is more helpful, natural, and pertinent.

• Craft clear and organized rationales that explain rankings and cite specific conversation turns.

• Confirm debug information to verify the correct data sources have been utilized.

• Uphold strict workflow hygiene, including the deletion of evaluation conversations when necessary.

⛳️ Requirements

• Proficient in RUSSIAN (both reading and writing are essential) — RUSSIAN serves as the primary evaluation language.

• A BS/BA degree or equivalent experience in a related field (such as Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or another analytical discipline).

• Strong analytical skills with the ability to evaluate nuanced AI outputs.

• Exceptional written communication abilities with a knack for producing structured evaluation notes.

• Keen attention to detail when comparing similar responses.

• Capacity to work independently in a fully remote setting.

• Dependable desktop/laptop and reliable internet connection.

• Willingness to utilize your primary personal Google account and activate personal data sources for evaluation purposes.

🏝️ Benefits

• Competitive salary and compensation package.

• Flexible working hours and fully remote work environment.

• Opportunities for professional development and growth.

• Collaborative and inclusive team culture.