AI Safety Expert, English & Assamese

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red team assessments on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistent testing protocols.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs related to sensitive subjects such as bias, misinformation, or harmful behaviors.

• Detect vulnerabilities that automated tests may overlook.

• Broaden evaluation coverage and minimize unexpected production issues.

• Enhance customer AI systems through adversarial testing strategies.

⛳️ Requirements

• Proficiency in both English and Assamese is required.

• Previous experience in red teaming within AI adversarial contexts, cybersecurity, or socio-technical probing.

• Capability to adversarially probe AI systems and push them to their limits.

• Familiarity with frameworks or benchmarks for structured testing methodologies.

• Ability to communicate risks effectively to both technical and non-technical audiences.

• Flexibility to adapt across various projects and client needs.

• Must hold independent contractor status.

• Unable to provide support for H1-B or STEM OPT candidates.

• Nice-to-have: experience in adversarial machine learning, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Nice-to-have: background in cybersecurity, including penetration testing, exploit development, or reverse engineering.

• Nice-to-have: experience with socio-technical risks, including harassment/disinformation probing, abuse analysis, or testing of conversational AI.

• Nice-to-have: creative probing skills in psychology, acting, or writing.

🏝️ Benefits

• Flexible working hours; tasks can be completed according to your own schedule.

• Weekly payments via Stripe or Wise based on services provided.

• Fully remote work environment.

• Opportunity to gain experience in human data-driven AI red teaming.

• Direct involvement in enhancing the robustness, safety, and trustworthiness of AI systems.

• Collaboration with top researchers in the field.

• Competitive compensation.

• Participation in higher-sensitivity projects is optional.

• Clear guidelines and wellness resources available for projects involving sensitive content.

• Referral bonuses of up to $90 for each successful referral.