AI Safety Expert – English, Odia

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red team assessments of conversational AI models and agents through techniques such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistency in testing.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Analyze AI outputs related to sensitive subjects including bias, misinformation, or harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage and minimize unexpected issues during production.

• Enhance customer AI systems through adversarial testing.

⛳️ Requirements

• Native proficiency in both English and Odia.

• Strong discernment regarding language and content.

• Capability to evaluate the accuracy, completeness, and appropriateness of AI responses, along with the ability to articulate the rationale behind these assessments.

• Meticulous attention to detail regarding subtle errors, inconsistencies, and gaps.

• Consistent adherence to guidelines and quality standards.

• Effective communication skills for both technical and non-technical audiences.

• Flexibility to adapt across different projects, task types, and client needs.

• Engagement as an independent contractor.

• Must not require H1-B or STEM OPT sponsorship.

• Preferred: experience in adversarial machine learning, including familiarity with jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Preferred: background in cybersecurity, including penetration testing, exploit development, or reverse engineering.

• Preferred: experience in socio-technical risk, such as harassment/disinformation investigations, abuse analysis, or testing of conversational AI.

• Preferred: knowledge in psychology, acting, or writing for innovative adversarial thinking.

🏝️ Benefits

• Fully remote position.

• Flexible working hours, allowing you to set your own schedule.

• Weekly payments facilitated through Stripe or Wise.

• Project durations may be adjusted, extended, or concluded early based on needs and performance.

• Participation in higher-sensitivity projects is optional.

• Clear and concise content guidelines provided.

• Access to wellness resources.

• Reasonable accommodations available upon request.

• Opportunity to gain experience in human data-driven AI red teaming.

• Collaborate with leading researchers in the field.

• Referral bonuses of up to $90 for each successful referral.