
AI Safety Expert β English, Gujarati
Posted Sep 19

Posted Sep 19
This is a fully remote position, open to applicants in United States.
β’ Conduct red-team assessments on conversational AI models and agents by using jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation techniques.
β’ Create human data by annotating errors, categorizing vulnerabilities, and identifying systemic risks.
β’ Implement taxonomies, benchmarks, and playbooks to ensure consistency in testing.
β’ Develop reproducible reports, datasets, and attack scenarios for clients.
β’ Evaluate AI outputs related to sensitive subjects such as bias, misinformation, and harmful actions.
β’ Broaden evaluation coverage and discover vulnerabilities that automated tests may overlook.
β’ Must possess native fluency in both English and Gujarati.
β’ Strong discernment regarding language and content, including assessing the accuracy, completeness, and appropriateness of AI-generated responses.
β’ Capability to identify subtle mistakes, inconsistencies, and gaps.
β’ Consistent adherence to guidelines and quality standards is essential.
β’ Ability to articulate reasoning clearly to both technical and non-technical audiences.
β’ Flexibility to adapt across various projects, task types, and client needs.
β’ Engagement as an independent contractor is required.
β’ Candidates must not be on an H1-B or STEM OPT visa.
β’ Preferred: experience with jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.
β’ Preferred: experience in penetration testing, exploit development, or reverse engineering.
β’ Preferred: experience in harassment/disinformation probing, abuse analysis, or testing conversational AI.
β’ Preferred: background in psychology, acting, or writing for unconventional adversarial thinking.
β’ Enjoy a fully remote position that allows you to work on your own schedule.
β’ Receive weekly payments through Stripe or Wise based on the services provided.
β’ Participation in higher-sensitivity projects is optional.
β’ Access clear guidelines and wellness resources for handling sensitive content.
β’ Reasonable accommodations available upon request.
β’ Gain experience in human data-driven AI red teaming.
β’ Play a direct role in enhancing the robustness, safety, and trustworthiness of AI systems.
β’ Earn referral payments of up to $90 for each successful referral.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.