AI Safety Experts, English, Kannada

This is a fully remote position, open to applicants in United States.

📋 Description

• Engage in red-team assessments of conversational AI models and agents by utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data through the annotation of failures, classification of vulnerabilities, and identification of systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistency in testing processes.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Analyze AI outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage and minimize unexpected issues in production.

• Enhance customer AI systems through adversarial testing.

⛳️ Requirements

• Native proficiency in both English and Kannada.

• Strong discernment regarding language and content, including assessing the accuracy, completeness, and appropriateness of AI responses.

• Capability to articulate reasoning clearly to both technical and non-technical audiences.

• Keen attention to subtle errors, inconsistencies, and gaps.

• Consistent adherence to guidelines and quality standards.

• Flexibility to adapt across various projects, task types, and client needs.

• Independent contractor status is required.

• Candidates must not be on an H1-B or STEM OPT visa.

• Preferred qualifications include specialties in adversarial ML, cybersecurity, socio-technical risk, or creative probing.

• Experience in adversarial ML with jailbreak datasets, prompt injections, RLHF/DPO attacks, or model extraction is advantageous.

• Background in cybersecurity with penetration testing, exploit development, or reverse engineering is a plus.

• Experience in socio-technical risk involving harassment/disinformation probing, abuse analysis, or conversational AI testing is beneficial.

• Background in creative probing through psychology, acting, or writing is a plus.

🏝️ Benefits

• Fully remote position.

• Flexible working hours; tasks can be completed according to your own schedule.

• Weekly payments processed through Stripe or Wise.

• Project durations may vary based on needs and performance; they can be extended, shortened, or concluded early.

• Participation in higher-sensitivity projects is optional.

• Access to clear guidelines and wellness resources for dealing with sensitive content.

• Reasonable accommodations available upon request.

• Competitive compensation.

• Opportunity to collaborate with leading researchers in the field.

• Referral bonuses of up to $90 for each successful referral, subject to conditions.