AI Content Analyst, Polish Language

📋 Description

• Design and conduct brief multi-turn dialogues (generally 1–5 turns) aimed at assessing AI personalization behavior.

• Develop prompts based on realistic personal scenarios to evaluate contextual comprehension.

• Analyze AI responses to ascertain whether personalization is accurately implemented.

• Assess grounding quality to ensure the model does not generate unsupported claims about the user.

• Evaluate integration quality by confirming that personal signals are integrated naturally (avoiding forced or mechanical responses).

• Compare two responses side by side to determine which is more helpful, natural, and relevant.

• Draft clear, structured rationales that explain rankings and reference specific conversation turns.

• Verify debug information to ensure that the correct data sources were utilized.

• Uphold strict workflow hygiene, including the deletion of evaluation conversations when necessary.

⛳️ Requirements

• Proficient in Polish (both reading and writing required) — Polish serves as the primary evaluation language.

• Bachelor's degree or equivalent experience in a relevant field (such as Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a related analytical discipline).

• Strong analytical skills and the ability to evaluate nuanced AI outputs.

• Exceptional written communication abilities with a talent for producing organized evaluation notes.

• Keen attention to detail when comparing similar responses.

• Capability to work independently in a completely remote setting.

• Dependable desktop/laptop and a stable internet connection.

• Willingness to utilize your primary personal Google account and enable personal data sources for evaluation purposes.

🏝️ Benefits

• Comprehensive health benefits including medical, dental, and vision coverage.

• Flexible work hours and the option for remote work.

• Opportunities for professional development and growth within the company.

• A collaborative and supportive work environment.