AI Safety Expert, English – Odia

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, identifying vulnerabilities, and highlighting systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistent testing practices.

• Generate reproducible reports, datasets, and attack cases for clients.

• Evaluate AI outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.

• Assist Mercor’s AI lab and enterprise clients in training and improving cutting-edge AI models.

• Identify vulnerabilities that automated tests may overlook.

• Broaden evaluation coverage and minimize surprises in production.

⛳️ Requirements

• Native fluency in both English and Odia is essential.

• Strong judgment regarding language and content is necessary.

• Capability to evaluate the accuracy, completeness, and appropriateness of AI responses and articulate the reasoning behind assessments.

• Keen eye for subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards.

• Ability to communicate reasoning clearly to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and client needs.

• Preferred qualifications include expertise in adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.

• Status as an independent contractor is required.

• H1-B and STEM OPT candidates are not eligible.

🏝️ Benefits

• Fully remote position.

• Flexible working hours, allowing you to set your own schedule.

• Weekly payments processed through Stripe or Wise.

• Project durations may vary based on requirements and performance.

• Participation in higher-sensitivity projects is voluntary.

• Access to clear content guidelines and wellness resources.

• Competitive compensation.

• Referral bonuses of up to $90 for each successful referral.