Senior QA Analyst / Tester

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement extensive adversarial testing campaigns targeting AI models, which encompass large language models, multimodal systems, and autonomous agents.

• Investigate attack vectors and prompt injection methods to uncover model weaknesses, jailbreaks, and unintended behaviors.

• Assess and integrate AI Security tools that reduce the mean time to detect and respond to AI-specific threats.

• Conduct red team exercises that simulate real-world deployment scenarios and edge cases.

• Examine for bias, toxicity, misinformation generation, and other harmful outputs across various contexts and demographics.

• Generate adversarial datasets and benchmarks to assess model resilience under different attack scenarios.

• Collaborate with security teams, member firm security divisions, and developers on red teaming initiatives.

• Document and present findings, vulnerabilities, and suggestions for remediation.

• Develop and uphold process documentation, create testing reports, monitor operational metrics, and perform additional programmatic tasks that support the AI Red Team function.

⛳️ Requirements

• A minimum of 5 years of experience in penetration testing, red team operations, or AI Red Team roles.

• A Bachelor’s degree or higher in computer science, information technology, programming, development, artificial intelligence, or cybersecurity is preferred, or equivalent professional experience.

• Experience in AI red teaming, red teaming, or offensive cyber operations.

• Familiarity with artificial intelligence, machine learning, software applications, cloud computing, and networking.

• Strong communication skills and the ability to manage stakeholders effectively.

• Capability to work efficiently across different geographies and time zones.

• Proficiency with testing tools such as SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike/Mythic/C2, NMAP, and sqlmap, or similar tools.

• Understanding of web application technologies and Layer 7 protocols including HTTP, DNS, and FTP.

• Technical expertise in Generative AI, Agentic AI, A2A, and/or MCP.

• Programming skills in Python, Ruby, Go, C++, PowerShell, bash, or similar languages.

• Industry-recognized AI or Red Team certifications such as OSCP, GPEN, GPXN, AI Red Teamer Job Role Path, AISEC+, GASAE, GOAA, or OSAI+ are preferred.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health and wellness benefits.

• Opportunities for professional development and training.

• Flexible work hours and remote work options.

• Collaborative and inclusive work environment.