AI Safety Expert – English, Odia

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents through tactics such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by documenting failures, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistency in testing.

• Generate reproducible reports, datasets, and attack scenarios.

• Evaluate AI outputs related to sensitive subjects, including bias, misinformation, and harmful behaviors.

• Discover vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage and minimize unexpected issues during production.

• Enhance customer AI systems through adversarial testing.

⛳️ Requirements

• Native fluency in both English and Odia.

• Strong judgment regarding language and content; capable of evaluating whether AI responses are accurate, complete, and suitable.

• Ability to clearly articulate reasoning to both technical and non-technical audiences.

• Meticulous attention to detail regarding subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards.

• Flexibility to adapt across various projects, task types, and clients.

• Nice-to-have: experience in adversarial machine learning, including familiarity with jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Nice-to-have: background in cybersecurity, including penetration testing, exploit development, or reverse engineering.

• Nice-to-have: experience with socio-technical risks, such as harassment/disinformation probing, abuse analysis, or testing conversational AI.

• Nice-to-have: experience in psychology, acting, or writing for innovative adversarial thinking.

• Must operate as an independent contractor.

• H1-B and STEM OPT candidates are not eligible.

🏝️ Benefits

• Fully remote position that allows for flexible scheduling.

• Weekly payments processed through Stripe or Wise based on services rendered.

• Participation in higher-sensitivity projects is optional.

• Access to clear guidelines and wellness resources for projects with higher sensitivity.

• Competitive compensation.

• Opportunity to earn up to $90 for each successful referral.