AI Safety Expert – English, Kannada

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents through techniques such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing practices.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs related to sensitive subjects like bias, misinformation, or harmful behaviors.

• Detect vulnerabilities that automated testing may overlook.

• Enhance evaluation coverage and minimize unforeseen issues in production.

• Fortify customer AI systems through adversarial testing.

⛳️ Requirements

• Native proficiency in both English and Kannada.

• Strong discernment regarding language and content, with the ability to evaluate if AI responses are accurate, thorough, and suitable.

• Capable of articulating reasoning clearly to both technical and non-technical audiences.

• Skilled at identifying subtle errors, inconsistencies, and gaps.

• Consistent adherence to guidelines and quality standards.

• Flexibility across various projects, task types, and clients.

• Nice-to-have: experience in adversarial machine learning, including knowledge of jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Nice-to-have: background in cybersecurity, encompassing penetration testing, exploit development, or reverse engineering.

• Nice-to-have: experience in socio-technical risk, including harassment/disinformation probing, abuse analysis, or conversational AI testing.

• Nice-to-have: creative probing experience in fields like psychology, acting, or writing.

• Must be able to operate as an independent contractor.

• H1-B and STEM OPT candidates are not eligible.

🏝️ Benefits

• Fully remote position that allows you to work according to your own schedule.

• Receive weekly payments through Stripe or Wise based on services provided.

• Project durations may be extended, shortened, or concluded early based on requirements and performance.

• Participation in higher-sensitivity projects is optional.

• Access to clear guidelines and wellness resources for higher-sensitivity projects.

• Competitive compensation.

• Opportunity to collaborate with leading researchers.

• Referral program offering up to $90 for each successful referral, subject to limits.

• Reasonable accommodations available upon request.