This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human-generated data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing methodologies.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Analyze AI outputs related to sensitive issues such as bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage to minimize unexpected challenges in production.

• Enhance customer AI systems and contribute to the development of safer, more reliable AI technologies.

⛳️ Requirements

• Native proficiency in English and Assamese.

• Previous experience in red teaming, particularly in AI adversarial contexts, cybersecurity, or socio-technical probing.

• Capability to test systems adversarially and push them to their limits.

• Familiarity with frameworks or benchmarks for structured testing approaches.

• Ability to communicate risks effectively to both technical and non-technical stakeholders.

• Flexibility to adapt to various projects and client needs.

• Desirable skills: adversarial ML, jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction, penetration testing, exploit development, reverse engineering, harassment/disinformation probing, abuse analysis, conversational AI testing, psychology, acting, or writing.

• Candidates must not be on an H1-B or STEM OPT visa.