
AI Safety Expert β English, Odia
Posted Sep 19

Posted Sep 19
This is a fully remote position, open to applicants in United States.
β’ Conduct red-team assessments on conversational AI models and agents by implementing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.
β’ Create human data by annotating failures, classifying vulnerabilities, and identifying systemic risks.
β’ Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing practices.
β’ Generate reproducible reports, datasets, and attack scenarios for clients.
β’ Evaluate AI outputs that pertain to sensitive issues such as bias, misinformation, or harmful behaviors.
β’ Engage in projects focused on training and improving AI systems.
β’ Identify vulnerabilities that automated tests overlook and enhance evaluation coverage.
β’ Proficiency in both English and Odia is mandatory.
β’ Strong discernment regarding language and content; capability to evaluate the accuracy, completeness, and appropriateness of AI responses.
β’ Skill in detecting subtle errors, inconsistencies, and gaps.
β’ Consistent adherence to guidelines and quality standards.
β’ Ability to articulate reasoning clearly to both technical and non-technical audiences.
β’ Flexibility to adapt across various projects, task types, and client needs.
β’ Engagement as an independent contractor is required.
β’ Note: H1-B and STEM OPT candidates cannot be accommodated.
β’ Preferred: experience in adversarial machine learning, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.
β’ Preferred: background in cybersecurity, including penetration testing, exploit development, or reverse engineering.
β’ Preferred: experience with socio-technical risks, including harassment/disinformation probing, abuse analysis, or conversational AI testing.
β’ Preferred: background in psychology, acting, or writing to foster unconventional adversarial thinking.
β’ Completely remote position.
β’ Flexible scheduling options.
β’ Weekly payments via Stripe or Wise.
β’ Chance to gain experience in human data-driven AI red teaming.
β’ Opportunity to contribute directly to enhancing the robustness, safety, and trustworthiness of AI systems.
β’ Collaborate with top-tier researchers in the field.
β’ Reasonable accommodations available upon request.
β’ Referral bonuses of up to $90 for each successful referral.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.