This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents through jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

• Document failures, classify vulnerabilities, and identify systemic risks.

• Implement taxonomies, benchmarks, and playbooks to ensure consistent testing.

• Generate reproducible reports, datasets, and attack scenarios.

• Evaluate AI outputs for bias, misinformation, and harmful behavior.

• Discover vulnerabilities that automated tests may overlook.

• Enhance evaluation coverage and minimize unexpected issues in production.

• Fortify customer AI systems through human data-driven red teaming.

⛳️ Requirements

• Proficient fluency in both English and Kannada is essential.

• Strong judgment regarding language and content; capable of evaluating whether AI responses are accurate, complete, and suitable, and articulate the reasons why.

• Keen ability to identify subtle errors, inconsistencies, and gaps.

• Consistent adherence to taxonomies, benchmarks, playbooks, guidelines, and quality standards.

• Ability to clearly communicate reasoning to both technical and non-technical audiences.

• Flexibility to adapt across various projects, task types, and clients.

• Status as an independent contractor.

• Must not require H1-B or STEM OPT sponsorship.

• Preferred areas of expertise include adversarial ML, cybersecurity, socio-technical risk, or creative probing.