
AI Safety Expert – English, Kannada
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in United States.
• Conduct red-team exercises on conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.
• Generate human data by annotating errors, categorizing vulnerabilities, and identifying systemic risks.
• Utilize taxonomies, benchmarks, and playbooks to maintain consistent testing practices.
• Create reproducible reports, datasets, and attack scenarios.
• Examine AI outputs for issues related to bias, misinformation, and harmful behaviors.
• Assist Mercor’s AI lab and enterprise clients in training and refining cutting-edge AI models.
• Broaden evaluation coverage and pinpoint vulnerabilities overlooked by automated testing methods.
• Proficiency in both English and Kannada is essential.
• Strong discernment regarding language and content quality.
• Capability to evaluate whether AI responses are accurate, comprehensive, and suitable, along with the ability to articulate reasoning.
• Meticulous attention to detail regarding subtle errors, inconsistencies, and omissions.
• Consistent adherence to guidelines and quality standards.
• Effective communication skills for both technical and non-technical audiences.
• Flexibility to adapt across various projects, tasks, and clients.
• Must be an independent contractor.
• Not eligible for H1-B or STEM OPT status.
• Preferred experience in areas such as adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.
• Fully remote position.
• Flexibility to work on your own schedule.
• Receive weekly payments through Stripe or Wise.
• Participation in higher-sensitivity projects is optional.
• Access to clear content guidelines and wellness resources.
• Competitive compensation.
• Opportunity for referrals, earning up to $90 for each successful referral.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.