AI Safety Expert – English, Gujarati

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments of conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Generate human-generated data by annotating failures, classifying vulnerabilities, and identifying systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistent testing methodologies.

• Create reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Enhance evaluation coverage and minimize unexpected outcomes in production.

⛳️ Requirements

• Required: Fluent/native proficiency in English and Gujarati.

• Strong judgment regarding language and content.

• Capability to evaluate the accuracy, completeness, and appropriateness of AI responses.

• Ability to communicate reasoning clearly to both technical and non-technical audiences.

• Skill in detecting subtle errors, inconsistencies, and gaps.

• Consistent adherence to guidelines and quality standards.

• Flexibility to adapt across various projects, task types, and clients.

• Status as an independent contractor.

• Must not require H1-B or STEM OPT sponsorship.

• Preferred: Experience in adversarial machine learning, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Preferred: Background in cybersecurity, including penetration testing, exploit development, or reverse engineering.

• Preferred: Experience in socio-technical risk, including harassment/disinformation probing, abuse analysis, or conversational AI testing.

• Preferred: Background in psychology, acting, or writing for unconventional adversarial thinking.

🏝️ Benefits

• Fully remote position.

• Flexible working hours / ability to work on your own schedule.

• Weekly payments through Stripe or Wise.

• Participation in higher-sensitivity projects is optional.

• Clear guidelines and wellness resources provided for sensitive-content tasks.

• Competitive compensation.

• Reasonable accommodations available upon request.

• Opportunity to gain experience in human data-driven AI red teaming.

• Chance to collaborate with leading researchers in the field.