
AI Safety Expert β English, Odia
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in United States.
β’ Conduct red-team assessments on conversational AI models and agents through jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.
β’ Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.
β’ Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing methodologies.
β’ Generate reproducible reports, datasets, and attack scenarios.
β’ Assess AI outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.
β’ Detect vulnerabilities that automated tests may overlook.
β’ Provide reproducible artifacts to enhance customer AI systems.
β’ Broaden evaluation coverage and minimize unexpected production issues.
β’ Proficiency in languages required: English and Odia.
β’ Native fluency in both English and Odia is essential.
β’ Strong discernment regarding language and content.
β’ Capability to evaluate the accuracy, completeness, and appropriateness of AI responses, with the ability to articulate reasoning.
β’ Meticulous attention to subtle errors, inconsistencies, and gaps.
β’ Consistent adherence to guidelines and quality standards.
β’ Ability to communicate reasoning clearly to both technical and non-technical audiences.
β’ Flexibility to adapt across various projects, task types, and clients.
β’ Status as an independent contractor is required.
β’ Candidates must not hold H1-B or STEM OPT status.
β’ Preferred specialties include adversarial machine learning, cybersecurity, socio-technical risk, and creative probing.
β’ Fully remote position.
β’ Flexible working hours allowing you to manage your own schedule.
β’ Weekly payments through Stripe or Wise.
β’ Competitive compensation.
β’ Optional involvement in higher-sensitivity projects.
β’ Clear guidelines and wellness resources available for work involving sensitive content.
β’ Reasonable accommodations provided upon request.
β’ Referral program offering up to $90 for each successful referral.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.