AI Content Analyst, Japanese

This is a fully remote position, open to applicants in Japan.

📋 Description

• Develop and facilitate brief multi-turn dialogues (typically 1–5 turns) aimed at assessing AI personalization capabilities.

• Construct prompts based on realistic personal situations to gauge contextual comprehension.

• Analyze AI replies to ascertain whether personalization is effectively implemented.

• Assess grounding quality to ensure the model refrains from generating unsupported assertions about the user.

• Evaluate integration quality — ensuring personal signals are utilized seamlessly (not forced or mechanical).

• Conduct side-by-side comparisons of two responses to identify which is more helpful, natural, and pertinent.

• Compose clear, organized rationales that explain rankings and reference specific conversation turns.

• Confirm debug information to verify the appropriate data sources were utilized.

• Uphold strict workflow hygiene, including the deletion of evaluation conversations when necessary.

⛳️ Requirements

• Proficient in Japanese (reading & writing mandatory) — Japanese serves as the primary evaluation language.

• BS/BA degree or equivalent experience in a relevant area (e.g., Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a related analytical discipline).

• Strong analytical skills with the ability to evaluate nuanced AI outputs.

• Exceptional written communication abilities with a knack for producing structured evaluation notes.

• Keen attention to detail when contrasting similar responses.

• Capability to work autonomously in a fully remote setting.

• Reliable desktop/laptop and stable internet connection required.

• Willingness to utilize your primary personal Google account and activate personal data sources for evaluation purposes.

🏝️ Benefits

• Competitive salary and compensation package.

• Flexible working hours and the opportunity to work remotely.

• Access to ongoing training and professional development opportunities.

• Collaborative and inclusive work culture.