This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents through methods such as jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Generate human data by annotating instances of failure, classifying vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing methodologies.

• Create reproducible reports, datasets, and attack scenarios for clients.

• Investigate AI outputs for issues related to bias, misinformation, and harmful behaviors.

• Discover vulnerabilities that automated testing may overlook.

• Enhance evaluation coverage while minimizing unexpected issues in production.

⛳️ Requirements

• Proficiency in English and Marathi is mandatory.

• Strong discernment regarding language and content, especially in assessing the accuracy, completeness, and appropriateness of AI-generated responses.

• Ability to articulate reasoning clearly to both technical and non-technical stakeholders.

• Meticulous attention to detail, including the identification of subtle errors, inconsistencies, and gaps.

• Consistent adherence to established guidelines and quality standards.

• Flexibility across various projects, task types, and client needs.

• Status as an independent contractor is required.

• H1-B and STEM OPT candidates will not be considered.