
AI Safety Expert β English, Marathi
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in United States.
β’ Conduct red-team assessments of conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.
β’ Create human data by annotating failures, classifying vulnerabilities, and identifying systemic risks.
β’ Implement taxonomies, benchmarks, and playbooks to ensure consistent testing procedures.
β’ Generate reproducible reports, datasets, and attack case studies.
β’ Evaluate AI outputs related to sensitive subjects, including bias, misinformation, or harmful behaviors.
β’ Assist in broadening evaluation coverage and enhancing customer AI systems.
β’ Engage in projects focused on training and improving frontier AI models.
β’ Native fluency in both English and Marathi is essential.
β’ Strong judgment regarding language and content is necessary.
β’ Capacity to assess the accuracy, completeness, and appropriateness of AI responses, along with the ability to explain the rationale.
β’ Skill in identifying subtle errors, inconsistencies, and gaps.
β’ Consistent adherence to guidelines and quality standards is required.
β’ Proficient at clearly articulating reasoning to both technical and non-technical audiences.
β’ Flexibility to adapt across various projects, task types, and client needs.
β’ Must possess independent contractor status.
β’ H1-B and STEM OPT candidates are not eligible for this position.
β’ Fully remote position.
β’ Flexible working hours; complete tasks on your own schedule.
β’ Receive weekly payments via Stripe or Wise.
β’ Competitive compensation offered.
β’ Collaborate with leading researchers in the field.
β’ Access to wellness resources and clear guidelines for projects with higher sensitivity.
β’ Reasonable accommodations available upon request.
β’ Earn up to $90 per successful referral as a bonus.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.