AI Safety Expert – English, Punjabi

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team evaluations of conversational AI models and agents through techniques such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Generate human data by annotating failures, classifying vulnerabilities, and identifying systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistency in testing.

• Create reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs related to sensitive subjects, including bias, misinformation, and harmful behaviors.

• Contribute to enhancing evaluation coverage and improving the safety, robustness, and trustworthiness of AI systems.

⛳️ Requirements

• Native fluency in both English and Punjabi is essential.

• Strong judgment regarding language and content quality.

• Capability to assess the accuracy, completeness, and appropriateness of AI responses, along with the ability to articulate reasoning.

• Keen attention to detail to identify subtle errors, inconsistencies, and gaps.

• Consistent adherence to guidelines and quality standards.

• Proficiency in articulating reasoning clearly to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and client needs.

• Must possess independent contractor status.

• Currently unable to support H1-B or STEM OPT candidates.

🏝️ Benefits

• Fully remote position.

• Flexible working hours; complete tasks according to your own schedule.

• Weekly payments via Stripe or Wise.

• Opportunity to gain experience in AI red teaming driven by human data.

• Play a direct role in enhancing the robustness, safety, and trustworthiness of AI systems.

• Collaborate with top researchers in the field.

• Reasonable accommodations available upon request.

• Referral opportunity: earn up to $90 for each successful referral.