
Engineering Manager, Software Security & AI Benchmark Delivery
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Pakistan, +5 more countries.
• Lead the development and execution of training and evaluation initiatives focused on security for cutting-edge AI coding models.
• Oversee delivery performance, technical quality, team capacity, and client alignment across various engineering pods.
• Coordinate with Pod Leads to ensure uniform execution across all pods.
• Plan task batches, delegate responsibilities, and track daily throughput against specific phase targets.
• Ensure that task batches fulfill Google's standards for volume, technical complexity, quality benchmarks, and delivery schedules.
• Conduct weekly client reporting, communicate progress updates, provide delivery forecasts, and proactively highlight risks or dependencies.
• Identify and escalate issues related to tooling, rate limits, safety blocks, staffing challenges, and other delivery risks.
• Collaborate directly with Google to clarify requirements and align on task scope, timelines, task volume, and any changes in difficulty.
• Perform final reviews of security tasks, ensuring technical accuracy, reproducibility, and resilience against gaming or superficial solutions.
• Train and calibrate Pod Leads on CWE classification, verifier robustness, task complexity, technical quality, and acceptance criteria.
• Conduct interviews and make hiring decisions aligned with approved role requirements and project capacity needs.
• Identify high-performing Trainers and facilitate their development and promotion into Pod Lead roles.
• Predict headcount needs using throughput, workload, and quality metrics.
• Initiate hiring campaigns roughly three weeks prior to anticipated capacity needs.
• Utilize dashboards, performance metrics, and operational indicators to inform delivery strategies and staffing plans.
• Over 10 years of professional software engineering experience, with a robust background in software security.
• Proven track record of leading technical teams to achieve measurable delivery, quality, and scheduling goals.
• Strong knowledge of CWE, CVE, and OWASP Top 10 across various programming languages and software ecosystems.
• Demonstrated experience in reproducing software vulnerabilities, reviewing security patches, and assessing proof-of-vulnerability tests.
• Experience in designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environments.
• Strong proficiency in at least one major programming language, such as Python, JavaScript / TypeScript, Java, C / C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
• Familiarity with Git, Linux, Bash, Docker, and standard software security tools.
• Ability to leverage dashboards, throughput metrics, quality data, and operational reports to make informed delivery and staffing decisions.
• Experience in managing or mentoring technical teams, including assigning tasks, reviewing outputs, providing feedback, and developing team leads.
• Exceptional written and verbal communication skills, with the ability to articulate technical risks and project status to clients and internal stakeholders.
• Strong organizational and prioritization abilities, capable of managing multiple pods, competing priorities, and delivery phases simultaneously.
• Comprehensive health and wellness benefits.
• Opportunities for professional development and continuous learning.
• Flexible work arrangements and a supportive work environment.
EX Squared
Lattice
Unanet
CVS Health
Get handpicked remote jobs straight to your inbox weekly.