AI Safety Expert – English, Tamil

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team evaluations of conversational AI models and agents through jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, classifying vulnerabilities, and identifying systemic risks.

• Implement taxonomies, benchmarks, and playbooks to maintain consistency in testing.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Analyze AI outputs concerning sensitive topics like bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation scope and minimize unexpected issues in production.

• Enhance customer AI systems to foster safer and more reliable AI.

⛳️ Requirements

• Native proficiency in English and Tamil is essential.

• Strong discernment regarding language and content.

• Capability to evaluate whether AI responses are accurate, comprehensive, and suitable, and articulate the reasoning behind assessments.

• Meticulous attention to subtle errors, inconsistencies, and gaps.

• Ability to consistently adhere to guidelines and quality standards.

• Skill in clearly communicating reasoning to both technical and non-technical audiences.

• Flexibility to adapt across various projects, tasks, and clients.

• Nice-to-have: experience in adversarial machine learning, including jailbreak datasets, prompt injections, RLHF/DPO attacks, or model extraction.

• Nice-to-have: background in cybersecurity, encompassing penetration testing, exploit development, or reverse engineering.

• Nice-to-have: experience in socio-technical risk, including harassment/disinformation investigations, abuse analysis, or conversational AI assessments.

• Nice-to-have: creative probing experience in psychology, acting, or writing.

• Must be engaged as an independent contractor.

• H1-B or STEM OPT candidates are not eligible.

🏝️ Benefits

• Fully remote position.

• Flexible working hours, allowing you to set your own schedule.

• Weekly payments processed through Stripe or Wise.

• Competitive compensation.

• Opportunity to gain experience in human data-driven AI red teaming at the forefront of safety.

• Direct involvement in enhancing the robustness, safety, and trustworthiness of AI systems.

• Participation in higher-sensitivity projects is optional.

• Clear guidelines and wellness resources available for projects involving sensitive content.

• Reasonable accommodations provided upon request.

• Referral program offering up to $90 for each successful referral (with referral limits applying).