
AI Safety Expert – English, Bengali
Posted Aug 31

Posted Aug 31
This is a fully remote position, open to applicants in United States.
• Engage in red teaming for conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.
• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.
• Utilize taxonomies, benchmarks, and playbooks to maintain consistency in testing.
• Generate reproducible reports, datasets, and attack scenarios for clients.
• Evaluate AI outputs related to sensitive issues like bias, misinformation, and harmful behaviors.
• Identify vulnerabilities that automated testing may overlook.
• Enhance evaluation coverage and minimize unexpected issues in production.
• Fortify customer AI systems through reproducible red-team artifacts.
• Required fluency in both English and Bengali, either fluent or native.
• Previous experience in red teaming, particularly in AI adversarial tasks, cybersecurity, or socio-technical probing.
• Capability to probe systems adversarially and test their limits.
• Proficiency in employing frameworks, benchmarks, taxonomies, and playbooks for structured testing processes.
• Skill in clearly communicating risks to both technical and non-technical stakeholders.
• Flexibility to adapt across various projects and clients.
• Engagement as an independent contractor.
• Must not hold an H1-B or STEM OPT status, as Mercor cannot accommodate these candidates.
• Fully remote position that allows you to work on your own schedule.
• Receive weekly payments via Stripe or Wise based on services provided.
• Option to participate in higher-sensitivity projects is available.
• Access to clear guidelines and wellness resources for handling sensitive content.
• Competitive compensation.
• Referral bonuses of up to $90 for each successful referral, with no cap on the number of referrals.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.