
AI Safety Expert – English, Punjabi
Posted Sep 18

Posted Sep 18
This is a fully remote position, open to applicants in United States.
• Conduct red-team assessments on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation techniques.
• Create human data by annotating failures, identifying vulnerabilities, and flagging systemic risks.
• Implement taxonomies, benchmarks, and playbooks to ensure consistent testing methodologies.
• Generate reproducible reports, datasets, and attack scenarios.
• Analyze AI outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.
• Identify vulnerabilities that automated tests may overlook.
• Broaden evaluation coverage and minimize unexpected issues during production.
• Enhance customer AI systems through rigorous adversarial testing.
• Native proficiency in English and Punjabi is essential.
• Strong discernment regarding language and content, including the ability to assess the accuracy, completeness, and appropriateness of AI responses.
• Capability to articulate reasoning clearly to both technical and non-technical audiences.
• Attention to detail in identifying subtle errors, inconsistencies, and gaps.
• Ability to consistently adhere to guidelines and quality standards.
• Flexibility to adapt across various projects, task types, and clientele.
• Engagement as an independent contractor is required.
• Candidates must not be on H1-B or STEM OPT visas.
• Experience in adversarial ML, cybersecurity, socio-technical risk, or creative probing is a plus.
• Fully remote position.
• Flexible work hours, allowing you to create your own schedule.
• Weekly payments processed via Stripe or Wise.
• Project timelines can be adjusted—extended, shortened, or concluded early based on needs and performance.
• Access to wellness resources and clear guidelines for projects with heightened sensitivity.
• Competitive compensation.
• Opportunity to collaborate with top researchers in the field.
• Referral bonuses of up to $90 for each successful referral.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.