AI Safety Expert – English, Bengali

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team evaluations of conversational AI models and agents through techniques such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Implement taxonomies, benchmarks, and playbooks to maintain consistency in testing.

• Generate reproducible reports, datasets, and attack scenarios.

• Evaluate AI outputs related to sensitive subjects, including bias, misinformation, or harmful behaviors.

• Identify vulnerabilities that automated tests may overlook.

• Broaden evaluation coverage to minimize surprises during production.

• Assist Mercor’s clients in enhancing the safety and robustness of their AI systems.

⛳️ Requirements

• Proficiency in both English and Bengali is essential.

• Strong discernment regarding language and content.

• Capability to evaluate whether AI responses are accurate, complete, and suitable, along with the ability to articulate the rationale.

• Skill in detecting subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards.

• Ability to clearly communicate reasoning to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and client needs.

• Preferred expertise includes adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.

• Must work as an independent contractor.

• H1-B and STEM OPT candidates are not eligible.

🏝️ Benefits

• Completely remote position.

• Flexibility to work on your own schedule.

• Weekly payments via Stripe or Wise.

• Competitive compensation.

• Optional participation in higher-sensitivity projects.

• Clear guidelines and wellness resources available for sensitive-content projects.

• Reasonable accommodations available upon request.

• Referral bonuses of up to $90 for each successful referral.