Data Annotation Specialist, Safety

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• Assess and enhance model safety: Label, rank, audit, and refine both human- and model-generated text to elevate safety, quality, and adherence to policies.

• Utilize nuanced safety judgment: Evaluate model outputs in alignment with comprehensive safety guidelines, rubrics, and stylistic standards.

• Develop prompts and safety test cases: Craft realistic prompts, user scenarios, and adversarial examples to test model behavior.

• Facilitate quality and calibration: Detect inconsistencies in annotations and offer actionable feedback.

• Operate with precision and autonomy: Execute annotation tasks with meticulous attention to detail.

⛳️ Requirements

• Minimum of 1 year of experience in Content Moderation, Trust and Safety, AI data annotation, LLM evaluation, or a comparable analytical position.

• Proven experience in applying detailed guidelines to intricate and sensitive content, coupled with strong contextual and sociocultural judgment, and the capability to recognize and mitigate personal bias.

• Emotional resilience: Ability to work with content that may include unsafe, explicit, and/or toxic elements, including material that is sexual, violent, or psychologically disturbing.

• Exceptional command of written English and the ability to articulate content evaluations clearly.

• Strong attention to detail and a commitment to accuracy.

• Proven ability to execute tasks in a remote environment, demonstrating effective time management and adaptability to new tools.

🏝️ Benefits

• Independent contractor agreement.

• Bring Your Own Device (BYOD).