AI Safety Experts – English, Bengali

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red team assessments of conversational AI models and agents through techniques such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing methodologies.

• Generate reproducible reports, datasets, and attack scenarios for client use.

• Evaluate AI outputs related to sensitive subjects like bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated tests may overlook.

• Enhance evaluation scope and minimize unexpected issues in production.

⛳️ Requirements

• Native proficiency in both English and Bengali.

• Strong discernment regarding language and content, with the capacity to evaluate the accuracy, completeness, and appropriateness of AI responses and articulate the reasoning behind assessments.

• Keen ability to detect subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards.

• Clear communication skills for explaining reasoning to both technical and non-technical audiences.

• Flexibility across various projects, task types, and client needs.

• Engagement as an independent contractor.

• Support for H1-B and STEM OPT candidates is not available.

• Preferred: experience in adversarial machine learning, including knowledge of jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Preferred: background in cybersecurity, encompassing penetration testing, exploit development, or reverse engineering.

• Preferred: experience in socio-technical risk management, involving harassment/disinformation probing, abuse analysis, or conversational AI testing.

• Preferred: background in psychology, acting, or writing to foster unconventional adversarial thinking.

🏝️ Benefits

• Fully remote position.

• Flexible working hours, allowing you to set your own schedule.

• Weekly payments processed through Stripe or Wise.

• Project durations may vary based on requirements and performance.

• Reasonable accommodations available upon request.

• Opportunity to gain experience in human data-driven AI red teaming.

• Direct involvement in enhancing the robustness, safety, and trustworthiness of AI systems.

• Collaboration with leading researchers in the field.

• Referral bonuses of up to $90 for each successful referral, subject to certain limits.