AI Safety Experts, English, Punjabi

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team evaluations of conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Analyze AI-generated outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.

• Document failures, categorize vulnerabilities, and identify systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to maintain consistency in testing.

• Generate reproducible reports, datasets, and attack case studies for clients.

• Investigate AI systems to reveal vulnerabilities that automated tests may overlook.

• Enhance evaluation coverage to minimize unexpected issues in production.

• Fortify customer AI systems through data-driven human red teaming.

⛳️ Requirements

• Fluent/native proficiency in English and Punjabi is essential.

• Strong judgment regarding language and content quality.

• Capable of evaluating AI responses for accuracy, completeness, and appropriateness, with the ability to articulate reasoning.

• Meticulous attention to detail regarding subtle errors, inconsistencies, and gaps.

• Consistently follow guidelines and uphold quality standards.

• Ability to clearly explain reasoning to both technical and non-technical audiences.

• Flexible and adaptable across various projects, task types, and customer needs.

• Engagement as an independent contractor.

• Must not require H1-B or STEM OPT support.

• Preferred specialties include adversarial ML, jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction, penetration testing, exploit development, reverse engineering, harassment/disinformation probing, abuse analysis, conversational AI evaluation, psychology, acting, and writing.

🏝️ Benefits

• Fully remote position.

• Flexibility to work on your own schedule.

• Weekly payments through Stripe or Wise based on services rendered.

• Project durations may be extended, shortened, or concluded early based on requirements and performance.

• Access to wellness resources and clear guidelines for higher-sensitivity projects.

• Opportunity to gain experience in human data-driven AI red teaming.

• Play a direct role in enhancing the robustness, safety, and trustworthiness of AI systems.

• Competitive compensation.

• Collaborate with leading researchers in the field.