AI Safety Expert – English, Marathi

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation.

• Generate human data by annotating failures, categorizing vulnerabilities, and highlighting systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure standardized testing procedures.

• Create reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs regarding sensitive subjects such as bias, misinformation, and harmful behaviors.

• Detect vulnerabilities that automated tests may overlook.

• Broaden evaluation scope and minimize unexpected issues in production.

• Assist clients in enhancing the safety, robustness, and reliability of their AI systems.

• Collaborate with prominent researchers on initiatives aimed at training and improving cutting-edge AI systems.

⛳️ Requirements

• Required: fluent/native proficiency in both English and Marathi.

• Strong discernment regarding language and content is essential.

• Capability to evaluate the accuracy, completeness, and appropriateness of AI responses, along with the ability to articulate reasoning.

• Meticulous attention to detail, especially concerning subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards is necessary.

• Proficient in clearly communicating reasoning to both technical and non-technical audiences.

• Adaptability across various projects, task types, and client needs.

• Must operate as an independent contractor.

• Not eligible for H1-B or STEM OPT support.

• Preferred: experience in adversarial machine learning, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Preferred: background in cybersecurity, encompassing penetration testing, exploit development, or reverse engineering.

• Preferred: experience with socio-technical risks, such as harassment/disinformation scrutiny, abuse analysis, or conversational AI testing.

• Preferred: background in psychology, acting, or writing to facilitate unconventional adversarial thinking.

🏝️ Benefits

• This position is fully remote.

• Enjoy a flexible schedule and the ability to work at your convenience.

• Receive weekly payments via Stripe or Wise.

• Project durations may be extended, shortened, or concluded early based on needs and performance.

• Participation in higher-sensitivity projects is voluntary.

• Access to clear guidelines and wellness resources for dealing with sensitive content.

• Reasonable accommodations provided upon request.

• Earn referral payments of up to $90 for each successful referral.