AI Safety Expert, English, Dutch

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red team assessments of conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing protocols.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Detect vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage and mitigate unexpected outcomes in production.

• Collaborate with top researchers to aid in the training and enhancement of advanced AI systems.

⛳️ Requirements

• Native proficiency in both English and Dutch.

• Previous experience in red teaming within AI adversarial contexts, cybersecurity, or socio-technical probing.

• Capability to challenge AI systems adversarially and push them to their limits.

• Familiarity with frameworks or benchmarks for systematic testing.

• Proficiency in clearly articulating risks to both technical and non-technical audiences.

• Flexibility to adapt across various projects and clients.

• Experience in adversarial machine learning, including knowledge of jailbreak datasets, prompt injections, RLHF/DPO attacks, or model extraction is preferable.

• Background in cybersecurity, including penetration testing, exploit development, or reverse engineering is advantageous.

• Experience with socio-technical risks, such as harassment/disinformation probing, abuse analysis, or testing conversational AI is a plus.

• Creative probing experience in fields such as psychology, acting, or writing is a bonus.

• Must be able to operate as an independent contractor.

• H1-B and STEM OPT candidates are not eligible.

🏝️ Benefits

• Fully remote position.

• Flexible working hours; manage your own schedule.

• Weekly payments processed via Stripe or Wise based on services provided.

• Project durations may be extended, shortened, or concluded ahead of schedule based on needs and performance.

• Participation in higher-sensitivity projects is optional.

• Clear content guidelines and wellness resources available.

• Reasonable accommodations provided upon request.

• Competitive remuneration.

• Referral program offering up to $250 for each successful referral, subject to specific limits.