This is a fully remote position, open to applicants in United States.

📋 Description

• Create adversarial prompts to rigorously assess leading-edge AI models

• Detect jailbreaks, unsafe behaviors, hallucinations, and policy violations

• Assess model resilience across domains such as misinformation, cyber threats, biosecurity, fraud, political content, and other sensitive areas

• Document weaknesses and assist in safety benchmarking and red-teaming documentation

• Collaborate with AI researchers to enhance model alignment, resilience, and safety

• Engage in projects aimed at training and improving AI systems

⛳️ Requirements

• A Bachelor's degree or higher in Computer Science, Cybersecurity, Journalism, Communications, Psychology, Biology, Chemistry, Public Policy, or a related field

• Over 5 years of professional experience in AI Safety, AI Red Teaming, Trust & Safety, cybersecurity, investigative journalism, life sciences, or a related area

• Excellent analytical reasoning, prompt creation, and written communication abilities

• Experience in designing adversarial prompts or assessing leading-edge AI systems

• Preferred: Experience with AI Red Teaming, Reinforcement Learning from Human Feedback (RLHF), Supervised Fine-Tuning (SFT), AI Alignment, or Trust & Safety

• Preferred: Knowledge of jailbreak testing, prompt engineering, or adversarial evaluation techniques

• Preferred: Expertise in one or more grey-area domains, including cyber, biosecurity, political content, misinformation, or scientific safety

• Must be capable of working as an independent contractor

• H1-B and STEM OPT candidates are not eligible