
AI Safety Expert, English β Bengali
Posted 5 days ago

Posted 5 days ago
This is a fully remote position, open to applicants in United States.
β’ Conduct red-team assessments of conversational AI models and agents through techniques such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.
β’ Create human data by annotating errors, categorizing vulnerabilities, and identifying systemic risks.
β’ Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing processes.
β’ Generate reproducible reports, datasets, and attack scenarios for clients.
β’ Analyze AI outputs relating to sensitive subjects, including bias, misinformation, and harmful behaviors.
β’ Increase evaluation coverage and reveal vulnerabilities that automated tests may overlook.
β’ Native proficiency in English and Bengali.
β’ Strong discernment regarding language and content, including the ability to evaluate the accuracy, completeness, and appropriateness of AI responses.
β’ Capacity to detect subtle errors, inconsistencies, and omissions.
β’ Consistent adherence to guidelines and quality standards.
β’ Ability to articulate reasoning clearly to both technical and non-technical audiences.
β’ Flexibility in adapting to various projects, task types, and client needs.
β’ Independent contractor status.
β’ Must not require H1-B or STEM OPT sponsorship.
β’ Preferred expertise includes adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.
β’ Fully remote work.
β’ Flexible scheduling.
β’ Weekly payments through Stripe or Wise.
β’ Project durations may vary based on needs and performance, with potential for extension, shortening, or early conclusion.
β’ Participation in higher-sensitivity projects is optional.
β’ Access to clear guidelines and wellness resources for managing sensitive-content tasks.
β’ Reasonable accommodations available upon request.
β’ Referral bonuses of up to $90 for each successful referral.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.