AI Safety Expert – English, Punjabi

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents by exploiting jailbreaks, prompt injections, misuse scenarios, bias issues, and multi-turn manipulations.

• Create high-quality human data through the annotation of failures, classification of vulnerabilities, and identification of systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to maintain consistency in testing procedures.

• Generate reproducible reports, datasets, and attack scenarios that clients can implement.

• Evaluate AI outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation scope by testing additional scenarios and minimizing production surprises.

⛳️ Requirements

• Native proficiency in both English and Punjabi is mandatory.

• Strong judgment regarding language and content, including the ability to assess the accuracy, completeness, and appropriateness of AI-generated responses.

• Capability to articulate reasoning clearly to both technical and non-technical audiences.

• Keen attention to detail for identifying subtle errors, inconsistencies, and gaps.

• Consistent adherence to guidelines and quality standards.

• Flexibility to adapt to various projects, task types, and client needs.

• Engagement as an independent contractor.

• Candidates must not be on an H1-B visa or STEM OPT.

• Preferred: experience in adversarial machine learning, including knowledge of jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Preferred: background in cybersecurity, including penetration testing, exploit development, or reverse engineering.

• Preferred: experience with socio-technical risks, such as harassment/disinformation probing, abuse analysis, or conversational AI testing.

• Preferred: creative probing experience in psychology, acting, or writing.

🏝️ Benefits

• Fully remote position that allows for flexible scheduling.

• Weekly compensation through Stripe or Wise based on services performed.

• Participation in higher-sensitivity projects is optional.

• Access to clear guidelines and wellness resources for sensitive-content projects.

• Opportunity to gain experience in human data-driven AI red teaming.

• Direct involvement in enhancing the robustness, safety, and trustworthiness of AI systems.

• Competitive compensation.

• Collaboration with leading researchers in the field.

• Reasonable accommodations available upon request.