AI Safety Expert – English, Kannada

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents, utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation techniques.

• Create human data by annotating failures, categorizing vulnerabilities, and highlighting systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistent testing.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs related to sensitive subjects such as bias, misinformation, or harmful conduct.

• Identify vulnerabilities that automated tests may overlook.

• Broaden evaluation coverage and minimize unforeseen issues in production.

• Assist Mercor clients in enhancing the safety, robustness, and reliability of their AI systems.

⛳️ Requirements

• Native proficiency in both English and Kannada.

• Strong judgment regarding language and content, including the ability to assess whether AI responses are accurate, complete, and suitable.

• Capability to detect subtle errors, inconsistencies, and gaps.

• Consistently adhere to guidelines and quality standards.

• Ability to clearly articulate reasoning to both technical and non-technical audiences.

• Flexibility to adapt to various projects, task types, and client needs.

• Must operate as an independent contractor.

• Must not hold H1-B or STEM OPT status.

• Preferred: experience in adversarial ML, including knowledge of jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Preferred: background in cybersecurity, encompassing penetration testing, exploit development, or reverse engineering.

• Preferred: experience with socio-technical risks, including harassment/disinformation probing, abuse analysis, or testing conversational AI.

• Preferred: creative probing skills in psychology, acting, or writing.

🏝️ Benefits

• Fully remote position that allows for a flexible schedule.

• Weekly payments through Stripe or Wise based on services rendered.

• Participation in higher-sensitivity projects is optional.

• Access to clear guidelines and wellness resources for sensitive-content projects.

• Competitive compensation.

• Direct involvement in human data-driven AI red teaming.

• Opportunity to collaborate with top researchers in the field.

• Referral bonuses of up to $90 for each successful referral, subject to limitations.