This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct red-team assessments on conversational AI models and agents through jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

• Create human data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.

• Utilize taxonomies, benchmarks, and playbooks to ensure testing consistency.

• Generate reproducible reports, datasets, and attack case studies.

• Evaluate AI outputs concerning sensitive issues such as bias, misinformation, and harmful behaviors.

• Identify vulnerabilities that automated tests overlook.

• Broaden evaluation coverage and minimize surprises in production.

• Enhance customer AI systems and aid in creating safer, more reliable AI solutions.

• Collaborate with prominent researchers on initiatives focused on training and improving cutting-edge AI models.

⛳️ Requirements

• Proficient/native fluency in both English and Odia.

• Strong discernment regarding language and content; capable of evaluating the accuracy, completeness, and appropriateness of AI responses, along with the ability to articulate the reasons behind assessments.

• Keen observation skills for identifying subtle errors, inconsistencies, and gaps.

• Consistent adherence to guidelines and quality standards.

• Ability to articulate reasoning effectively to both technical and non-technical audiences.

• Flexibility to adapt across various projects, tasks, and client needs.

• Engagement as an independent contractor.

• Currently unable to support H1-B or STEM OPT candidates.

• Preferred areas of expertise: adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.