LLM AI Quality Analyst, Chinese

This is a fully remote position, open to applicants in United States.

📋 Description

• Assess personalized AI responses and evaluate their quality.

• Develop multi-turn prompts that draw from personal experiences and context.

• Analyze AI responses for accuracy, usefulness, and suitable personalization.

• Detect incorrect personalization, unsupported assumptions, and hallucinations.

• Compare AI responses in a side-by-side format and offer detailed feedback.

• Compose clear rationales to explain evaluations.

• Complete the online assessment within a 24-hour timeframe.

• Engage in a pre-onboarding discussion.

⛳️ Requirements

• Proficient in reading and writing Chinese.

• Strong analytical and critical-thinking abilities.

• Excellent written communication skills.

• Preferred experience in AI evaluation, data annotation, content moderation, linguistics, research, or a similar field.

• Bachelor's degree or equivalent experience required.

• Ability to work independently in a remote setting.

• A laptop or desktop computer with a reliable internet connection.

• Willingness to use a primary personal Google account and activate relevant personal data sources for evaluation purposes.

• Availability to work 30 or 40 hours each week.

• Minimum requirement of 4 hours of work per day.

• Capability to provide 4 hours of overlap with PST.

• Must reside in the USA; candidates from Texas and Illinois will not be considered.

• Strong proficiency in the Chinese language.

🏝️ Benefits

• Flexible remote work setup.

• Ideal for students.

• Paperless pay statements.

• Medical benefits included.

• Vision benefits offered.

• Flexible spending account for medical and dependent care.

• Dental benefits available.