AI Safety Experts, English, Assamese

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments of conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by annotating errors, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing procedures.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs regarding sensitive issues including bias, misinformation, and harmful behaviors.

• Detect vulnerabilities that automated tests may overlook.

• Broaden evaluation coverage and minimize unexpected production issues.

• Collaborate on initiatives aimed at training and improving cutting-edge AI systems.

⛳️ Requirements

• Native proficiency in both English and Assamese is essential.

• Strong discernment regarding language and content, particularly in assessing the accuracy, completeness, and appropriateness of AI responses.

• Ability to articulate reasoning effectively to both technical and non-technical audiences.

• Meticulous attention to detail, including subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards.

• Flexibility to adapt to various projects, task types, and clients.

• Preferred: experience in adversarial machine learning, encompassing jailbreak datasets, prompt injection, RLHF/DPO attacks, and model extraction.

• Preferred: background in cybersecurity, including penetration testing, exploit development, and reverse engineering.

• Preferred: experience in socio-technical risk assessment, including probing for harassment/disinformation, abuse analysis, and conversational AI evaluation.

• Preferred: background in psychology, acting, or writing for innovative adversarial thinking.

• Must operate as an independent contractor.

• Must not require H1-B or STEM OPT sponsorship.

🏝️ Benefits

• Fully remote work environment.

• Flexible scheduling to meet personal needs.

• Weekly payments processed through Stripe or Wise.

• Competitive compensation.

• Access to wellness resources and clear guidelines for projects with higher sensitivity.

• Reasonable accommodations available upon request.

• Project durations may vary based on requirements and performance.

• Opportunity to gain experience in human data-driven AI red teaming.

• Chance to contribute to making AI systems more robust, safe, and trustworthy.

• Referral bonuses of up to $90 for each successful referral, subject to certain limits.