AI Safety Expert, English, Odia

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Adhere to taxonomies, benchmarks, and playbooks to maintain consistency in testing.

• Generate reproducible reports, datasets, and attack scenarios.

• Evaluate AI outputs that involve sensitive subjects like bias, misinformation, and harmful behaviors.

• Detect vulnerabilities that automated testing may overlook.

• Enhance evaluation coverage and minimize unexpected issues in production.

• Assist Mercor clients in ensuring AI systems are safer and more reliable.

⛳️ Requirements

• Proficiency in both English and Odia is essential.

• Strong discernment regarding language and content quality.

• Capability to evaluate if AI responses are accurate, complete, and suitable, along with the ability to articulate the rationale.

• Keen attention to detail, including subtle mistakes, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards.

• Ability to communicate reasoning clearly to both technical and non-technical audiences.

• Flexibility to adapt across various projects, tasks, and client needs.

• This position is for independent contractors.

• H1-B and STEM OPT candidates are not eligible.

🏝️ Benefits

• Fully remote position.

• Flexible working hours, allowing you to work on your own schedule.

• Weekly compensation through Stripe or Wise.

• Project duration may vary based on needs and performance, with the potential for extensions, reductions, or early conclusions.

• Reasonable accommodations available upon request.

• Access to wellness resources and clear guidelines for projects of heightened sensitivity.

• Opportunity to gain experience in human data-driven AI red teaming.

• Collaborate with top researchers in the field.

• Referral bonuses of up to $90 for each successful referral.