AI Safety Red Teamer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop adversarial prompts to assess the resilience of advanced AI models.

• Detect jailbreaks, unsafe behaviors, hallucinations, and policy shortcomings.

• Assess model stability in areas such as misinformation, cybersecurity, biosecurity, fraud, political content, and other sensitive sectors.

• Record vulnerabilities and assist in the creation of safety benchmarking and red-teaming documentation.

• Collaborate with AI researchers to enhance model alignment, robustness, and safety measures.

• Engage in projects aimed at training and improving AI systems.

⛳️ Requirements

• A Bachelor’s degree or higher in Computer Science, Cybersecurity, Journalism, Communications, Psychology, Biology, Chemistry, Public Policy, or a related field.

• Over 5 years of professional experience in AI Safety, AI Red Teaming, Trust & Safety, cybersecurity, investigative journalism, life sciences, or a closely related domain.

• Exceptional analytical reasoning, prompt creation, and written communication abilities.

• Proven experience in designing adversarial prompts or assessing advanced AI systems.

• Preferred: experience in AI Red Teaming, Reinforcement Learning from Human Feedback (RLHF), Supervised Fine-Tuning (SFT), AI Alignment, or Trust & Safety.

• Preferred: knowledge of jailbreak testing, prompt engineering, or adversarial evaluation techniques.

• Preferred: expertise in cybersecurity, biosecurity, political content, misinformation, or scientific safety.

• Must have eligibility to work in one of the specified location-requirement countries.

• Mercor is currently unable to support H1-B or STEM OPT candidates.

🏝️ Benefits

• Fully remote position.

• Flexible working hours; tasks can be completed according to your own schedule.

• Weekly payments through Stripe or Wise.

• Opportunity to collaborate with top AI researchers and safety teams.

• Chance to impact the safety of frontier AI and model alignment.

• Project durations may vary, with possibilities for extension, shortening, or early conclusion based on requirements and performance.

• Referral bonuses of up to $340 for each successful referral, with no cap on the number of referrals (some restrictions may apply).