This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team exercises on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation techniques.

• Create human data by annotating failures, identifying vulnerabilities, and highlighting systemic risks.

• Adhere to established taxonomies, benchmarks, and playbooks to ensure consistent testing.

• Generate reproducible reports, datasets, and attack scenarios for clients.

• Examine AI outputs related to sensitive subjects such as bias, misinformation, and harmful behavior.

• Identify vulnerabilities that automated tests may overlook.

• Enhance evaluation scope and minimize unexpected production issues.

• Fortify customer AI systems through adversarial testing.

⛳️ Requirements

• Native fluency in both English and Gujarati is essential.

• Strong judgment regarding language and content; ability to evaluate whether AI responses are accurate, complete, and suitable, along with the capability to articulate reasoning.

• Keen ability to detect subtle errors, inconsistencies, and gaps.

• Consistently follow guidelines and quality standards.

• Capability to communicate reasoning effectively to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and client needs.

• Must be an independent contractor.

• Candidates must not hold an H1-B or STEM OPT visa.

• Preferred qualifications include expertise in adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.