This is a fully remote position, open to applicants in United States.

📋 Description

• Engage in red-team activities for conversational AI models and agents by employing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Create human data through the annotation of failures, classification of vulnerabilities, and identification of systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistency in testing.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Evaluate AI outputs concerning sensitive subjects, including bias, misinformation, or harmful behaviors.

• Identify vulnerabilities that automated tests often overlook.

• Broaden evaluation coverage while minimizing unexpected outcomes in production.

• Contribute to enhancing the safety, robustness, and reliability of advanced AI systems.

⛳️ Requirements

• Proficiency in both English and Telugu is essential.

• Strong discernment regarding language and content; capable of evaluating whether AI responses are accurate, comprehensive, and suitable, along with the ability to articulate reasoning.

• Meticulous attention to detail regarding subtle errors, inconsistencies, and omissions.

• Consistency in adhering to guidelines and quality standards.

• Ability to articulate reasoning clearly to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and clients.

• Must maintain independent contractor status.

• Candidates must not hold H1-B or STEM OPT status.

• Preferred areas of expertise include adversarial machine learning, cybersecurity, socio-technical risk, or innovative probing techniques.