AI Safety Expert – English, Punjabi

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents by exploiting jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to maintain consistent testing methodologies.

• Generate reproducible reports, datasets, and attack scenarios.

• Analyze AI outputs for bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated testing may overlook.

• Enhance evaluation coverage to minimize unexpected issues in production.

• Fortify customer AI systems through adversarial testing.

⛳️ Requirements

• Proficiency in English and Punjabi is essential.

• Native-level fluency in both English and Punjabi is required.

• Strong judgment regarding language and content quality.

• Capability to evaluate the accuracy, completeness, and appropriateness of AI responses and articulate reasoning behind assessments.

• Keen attention to detail to identify subtle errors, inconsistencies, and omissions.

• Consistent adherence to guidelines and quality standards is necessary.

• Ability to communicate reasoning clearly to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and clients.

• Must hold independent contractor status.

• Candidates on H1-B and STEM OPT visas are not eligible.

🏝️ Benefits

• Fully remote position.

• Flexible working hours.

• Weekly payments through Stripe or Wise.

• Opportunity to gain experience in human data-driven AI red teaming.

• Direct involvement in enhancing the robustness, safety, and trustworthiness of AI systems.

• Competitive compensation.

• Collaboration with top researchers in the field.

• Reasonable accommodations available upon request.

• Participation in higher-sensitivity projects is optional.

• Clear guidelines and wellness resources provided for higher-sensitivity projects.