AI Safety Expert, English – Punjabi

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team evaluations of conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, classifying vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to maintain consistency in testing.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Analyze AI outputs related to sensitive subjects, including bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage and minimize unexpected outcomes in production.

• Foster customer confidence in AI safety through adversarial testing.

⛳️ Requirements

• Proficiency in both English and Punjabi is essential.

• Strong judgment regarding language and content quality.

• Capability to evaluate the accuracy, completeness, and appropriateness of AI responses, along with the ability to articulate the rationale.

• Keen attention to subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards.

• Ability to communicate reasoning effectively to both technical and non-technical audiences.

• Flexibility across different projects, task types, and client requirements.

• Engagement as an independent contractor.

• Currently unable to support H1-B or STEM OPT candidates.

• Preferred: experience in adversarial machine learning, including jailbreak datasets, prompt injection, RLHF/DPO attacks, and model extraction.

• Preferred: experience in cybersecurity, encompassing penetration testing, exploit development, and reverse engineering.

• Preferred: experience in socio-technical risk assessment, including harassment/disinformation probing, abuse analysis, and conversational AI testing.

• Preferred: background in psychology, acting, or writing for innovative adversarial thinking.

🏝️ Benefits

• Fully remote position.

• Flexible work schedule, allowing you to manage your time effectively.

• Weekly payments processed through Stripe or Wise.

• Participation in higher-sensitivity projects is optional.

• Access to clear content guidelines and wellness resources.

• Project durations may vary based on needs and performance.

• Competitive compensation.

• Opportunity to collaborate with top researchers in the field.

• Referral payments of up to $90 for each successful recommendation.