This is a fully remote position, open to applicants in United States.

📋 Description

• Develop adversarial prompts to rigorously test cutting-edge AI models.

• Detect jailbreaks, unsafe behaviors, hallucinations, and failures in policy adherence.

• Assess model resilience in areas such as misinformation, cybersecurity, biosecurity, fraud, political content, and other sensitive sectors.

• Record vulnerabilities and assist in the creation of safety benchmarking and red-teaming reports.

• Partner with AI researchers to enhance model alignment, robustness, and safety.

• Engage in projects aimed at training and advancing AI systems.

⛳️ Requirements

• A Bachelor's degree or higher in Computer Science, Cybersecurity, Journalism, Communications, Psychology, Biology, Chemistry, Public Policy, or a related field.

• Over 5 years of professional experience in AI Safety, AI Red Teaming, Trust & Safety, cybersecurity, investigative journalism, life sciences, or a similar area.

• Excellent analytical reasoning, prompt design, and written communication abilities.

• Proven experience in creating adversarial prompts or evaluating advanced AI systems.

• Preferred: background in AI Red Teaming, Reinforcement Learning from Human Feedback (RLHF), Supervised Fine-Tuning (SFT), AI Alignment, or Trust & Safety.

• Preferred: knowledge of jailbreak testing, prompt engineering, or adversarial evaluation techniques.

• Preferred: specialization in cybersecurity, biosecurity, political content, misinformation, or scientific safety.

• Ability to work independently as a contractor.

• H1-B and STEM OPT candidates are not eligible.