
AI Safety Expert β English, Odia
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in United States.
β’ Conduct red-team assessments of conversational AI models and agents through techniques such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.
β’ Document failures, categorize vulnerabilities, and identify systemic risks.
β’ Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing methodologies.
β’ Generate reproducible reports, datasets, and attack case studies.
β’ Analyze AI outputs with respect to bias, misinformation, and harmful behaviors.
β’ Broaden evaluation scope and pinpoint vulnerabilities that automated tests may overlook.
β’ Engage in projects focused on training and enhancing AI systems for Mercorβs AI lab and enterprise clientele.
β’ Fluency in English and Odia is essential.
β’ Strong evaluative skills regarding language and content.
β’ Capability to determine the accuracy, completeness, and appropriateness of AI responses, along with the ability to articulate the reasoning.
β’ Meticulous attention to minor errors, inconsistencies, and omissions.
β’ Consistent adherence to guidelines and quality standards.
β’ Ability to communicate reasoning effectively to both technical and non-technical audiences.
β’ Flexibility to adapt across various projects, task types, and clients.
β’ Must work as an independent contractor.
β’ Currently unable to accommodate H1-B or STEM OPT candidates.
β’ Fully remote position that allows for flexible scheduling.
β’ Optional involvement in higher-sensitivity projects.
β’ Clear protocols and wellness resources available for managing sensitive content.
β’ Weekly compensation through Stripe or Wise based on services provided.
β’ Competitive salary.
β’ Opportunity to collaborate with leading researchers in the field.
β’ Reasonable accommodations available upon request.
β’ Referral program offering up to $90 for each successful referral (with certain limits).
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.