
AI Safety Expert β English, Danish
Posted Sep 15

Posted Sep 15
This is a fully remote position, open to applicants in United States.
β’ Conduct red-team assessments on conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.
β’ Create high-quality human data by annotating errors, identifying vulnerabilities, and highlighting systemic risks.
β’ Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing procedures.
β’ Generate reproducible reports, datasets, and attack scenarios for clients.
β’ Identify vulnerabilities that automated testing might overlook.
β’ Broaden evaluation coverage and minimize unexpected issues in production.
β’ Enhance customer AI systems through adversarial testing methodologies.
β’ Collaborate with top researchers on initiatives focused on training and improving cutting-edge AI systems.
β’ Native proficiency in both English and Danish.
β’ Previous experience in red teaming within AI adversarial contexts, cybersecurity, or socio-technical probing.
β’ Capability to adversarially probe AI systems and challenge their limits.
β’ Proficient in utilizing structured frameworks, taxonomies, benchmarks, or playbooks.
β’ Ability to communicate risks effectively to both technical and non-technical audiences.
β’ Flexibility to adapt across various projects and client needs.
β’ Status as an independent contractor.
β’ Not eligible as an H1-B or STEM OPT candidate.
β’ Preferred qualifications include expertise in adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.
β’ Experience in adversarial machine learning may encompass jailbreak datasets, prompt injections, RLHF/DPO attacks, or model extraction techniques.
β’ Cybersecurity experience may involve penetration testing, exploit development, or reverse engineering.
β’ Experience with socio-technical risks may include probing for harassment/disinformation, abuse analysis, or testing conversational AI systems.
β’ Creative probing experience might involve psychology, acting, or writing skills.
β’ Fully remote position.
β’ Flexible, self-managed schedule.
β’ Weekly payments processed via Stripe or Wise.
β’ Projects may be extended, shortened, or concluded early based on needs and performance evaluations.
β’ Participation in higher-sensitivity projects is optional.
β’ Clear content guidelines and access to wellness resources.
β’ Competitive compensation.
β’ Referral program providing up to $250 for each successful referral.
β’ Reasonable accommodations available upon request.
β’ Opportunity to collaborate with leading researchers.
β’ Chance to gain experience in human data-driven AI red teaming.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.