
Senior Software Security Engineer, AI Benchmark Development
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Pakistan, +5 more countries.
• Research and analyze real-world vulnerabilities from CVEs, security advisories, bug reports, and open-source repositories.
• Identify and categorize vulnerabilities using the most precise applicable CWE and align them with relevant OWASP Top 10 categories when suitable.
• Replicate security issues and create dependable proof-of-vulnerability tests.
• Develop Harbor-format audit-and-patch tasks across various programming languages and software ecosystems.
• Draft realistic task instructions without disclosing vulnerable code, exploit specifics, or anticipated remediation.
• Construct reproducible Docker-based environments with specified dependencies, clear setup guidelines, and reliable execution protocols.
• Design and fortify automated verifiers to prevent exploitation, test manipulation, hardcoded solutions, and overfitting.
• Evaluate and score AI-generated patches and technical reasoning using structured security and engineering rubrics.
• Identify tasks that can be solved through superficial pattern recognition or by copying known upstream patches.
• Document vulnerability context, reproduction procedures, expected outcomes, patch prerequisites, testing methodologies, and review conclusions.
• Over 5 years of professional experience in software engineering.
• Expert-level knowledge in at least one of the following: Python; JavaScript / TypeScript; Java; C / C++; C#; Go; Rust; Ruby; PHP; Kotlin; Swift.
• Solid understanding of software security principles and prevalent vulnerability classes.
• Practical familiarity with CWE, CVE, and OWASP Top 10.
• Capability to independently reproduce vulnerabilities and create proof-of-vulnerability tests.
• Hands-on experience with security testing and analysis tools, including Sanitizers, Fuzzers, and static-analysis tools like CodeQL or Semgrep.
• Strong skills in Git, Linux, Bash, and Docker.
• Ability to develop automated tests and reproducible technical evaluation environments.
• Excellent technical writing abilities, with the capacity to clearly explain complex security issues and remediation requirements.
• Ability to work autonomously in a fully remote, research-focused environment.
• Competitive salary and performance-based bonuses.
• Flexible work hours and remote work options.
• Opportunities for professional development and continuous learning.
• Inclusive work culture that values diversity and collaboration.
SHI International Corp.
Anduril Industries
Hex
Mercola
Get handpicked remote jobs straight to your inbox weekly.