AI Safety Experts – English, Punjabi

This is a fully remote position, open to applicants in United States.

📋 Description

• Engage in red-teaming of conversational AI models and agents through jailbreak techniques, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data by documenting failures, categorizing vulnerabilities, and identifying systemic risks.

• Adhere to established taxonomies, benchmarks, and playbooks to ensure consistent testing.

• Develop reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs related to sensitive subjects such as bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Broaden evaluation coverage and minimize surprises in production.

• Enhance customer AI systems through adversarial testing.

⛳️ Requirements

• Must possess native fluency in both English and Punjabi.

• Strong discernment regarding language and content is essential.

• Capability to evaluate the accuracy, completeness, and appropriateness of AI responses, with the ability to articulate reasoning.

• Keen attention to detail for spotting subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards is necessary.

• Proficient in clearly conveying reasoning to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and client needs.

• Must be an independent contractor.

• Candidates must not be on an H1-B or STEM OPT visa.

• Preferred: experience in adversarial machine learning, including familiarity with jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

• Preferred: background in cybersecurity, such as penetration testing, exploit development, or reverse engineering.

• Preferred: experience in socio-technical risks, including harassment/disinformation probing, abuse analysis, or conversational AI testing.

• Preferred: skills in psychology, acting, or writing for unconventional adversarial perspectives.

🏝️ Benefits

• Fully remote position.

• Flexible working hours allowing you to set your own schedule.

• Weekly payment options via Stripe or Wise.

• Projects may be adjusted in length or concluded early based on needs and performance.

• Participation in higher-sensitivity projects is optional.

• Access to clear content guidelines and wellness resources.

• Competitive compensation.

• Reasonable accommodations available upon request.

• Referral bonuses of up to $90 for each successful referral (certain limits apply).