Korean Content Evaluation Specialist

This is a fully remote position, open to applicants in South Korea.

📋 Description

• Create high-quality prompts in Korean focusing on sensitive topics.

• Generate natural and culturally relevant content in the Korean language.

• Design realistic scenarios with diverse wording, tone, and complexity.

• Review prompts and dialogues according to established evaluation guidelines.

• Categorize content based on specified criteria.

• Evaluate sensitive and potentially dual-use information.

• Detect adversarial phrasing and patterns of escalation.

• Recognize attempts to bypass existing safeguards.

• Assess Korean-language content for its naturalness and contextual relevance.

• Utilize cultural insights when interpreting wording, tone, and implied meanings.

• Identify linguistic ambiguities that may impact classification.

• Provide clear written justifications to support evaluation decisions.

• Document the rationale for why prompts or conversations fulfill defined criteria.

• Clearly communicate nuanced decisions in written English when necessary.

• Maintain uniform standards and meticulous attention to detail across repeated review tasks.

⛳️ Requirements

• Native or near-native proficiency in Korean.

• Business-level proficiency in written English.

• A Bachelor’s degree completed or currently underway.

• Strong written reasoning skills and analytical judgment.

• Exceptional attention to detail.

• Good judgment when dealing with sensitive or dual-use information.

• Comfortable applying structured guidelines to ambiguous content.

• Experience in reviewing, grading, or assessing written or technical content is a plus.

• A background in trust and safety, content moderation, policy evaluation, red teaming, or adversarial testing is beneficial.

• Candidates located in South Korea or the broader East Asia region are especially encouraged to apply, though applicants from other locations are also welcome.

• Part-time independent contractor position.

• Work must be conducted without the use of confidential or proprietary information belonging to any employer, client, institution, or other third parties.

• H1-B and STEM OPT support is not available for this position.

🏝️ Benefits

• Flexible scheduling in accordance with project demands.

• Training on the project workflow will be provided.

• Fully remote work environment.

• Immediate start available.

• Project duration may be adjusted based on needs and performance.