AI Safety Red Teamer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create adversarial prompts to assess and challenge the capabilities of advanced AI models.

• Detect jailbreaks, unsafe actions, hallucinations, and failures in policy adherence.

• Assess model strength in relation to misinformation, cybersecurity, biosecurity, fraud, political issues, and other sensitive areas.

• Record vulnerabilities and assist in developing safety benchmarking and red-teaming documentation.

• Partner with AI researchers to enhance model alignment, robustness, and safety features.

• Engage in projects aimed at training and advancing AI systems.

⛳️ Requirements

• A Bachelor's degree or higher in Computer Science, Cybersecurity, Journalism, Communications, Psychology, Biology, Chemistry, Public Policy, or a related field.

• Over 5 years of professional experience in AI Safety, AI Red Teaming, Trust & Safety, cybersecurity, investigative journalism, life sciences, or a similar domain.

• Excellent analytical reasoning, prompt design, and written communication abilities.

• Experience in creating adversarial prompts or assessing cutting-edge AI systems.

• Preferred: Background in AI Red Teaming, Reinforcement Learning from Human Feedback (RLHF), Supervised Fine-Tuning (SFT), AI Alignment, or Trust & Safety.

• Preferred: Knowledge of jailbreak testing, prompt engineering, or adversarial evaluation techniques.

• Preferred: Proficiency in one or more grey-area sectors, such as cybersecurity, biosecurity, political content, misinformation, or scientific safety.

• Must be capable of working as an independent contractor.

• Mercor is currently unable to support H1-B or STEM OPT candidates.

🏝️ Benefits

• Fully remote position that allows you to work on your own schedule.

• Weekly payments through Stripe or Wise based on services provided.

• Project timelines can be extended, shortened, or concluded early based on requirements and performance.

• Opportunity to engage in pioneering adversarial testing with top AI researchers and safety teams.

• Chance to shape how AI systems tackle complex, real-world safety issues.

• Referral bonuses of up to $340 for each successful referral, subject to referral limits.

• Reasonable accommodations are available upon request.