This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red team assessments on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistent testing procedures.

• Generate reproducible reports, datasets, and attack scenarios.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage to minimize unexpected issues during production.

• Enhance customer AI systems through adversarial testing techniques.

⛳️ Requirements

• A native command of both English and Danish is essential.

• Previous experience in red teaming within AI adversarial contexts, cybersecurity, or socio-technical assessments is required.

• Capable of probing AI systems in an adversarial manner and pushing them to their limits.

• Familiarity with frameworks or benchmarks for systematic testing is necessary.

• Ability to articulate risks effectively to both technical and non-technical audiences.

• Flexibility across various projects and clientele is expected.

• Additional specialties that are advantageous include adversarial machine learning, cybersecurity, socio-technical risk, and innovative probing techniques.

• Must operate as an independent contractor.

• H1-B and STEM OPT applicants are not eligible.