Engineering Manager, Software Security & AI Benchmark Delivery

Posted 2 days ago

This is a fully remote position, open to applicants in Pakistan, +5 more countries.

📋 Description

• Lead the development and execution of training and evaluation initiatives focused on security for cutting-edge AI coding models.

• Oversee delivery performance, technical quality, team capacity, and client alignment across various engineering pods.

• Coordinate with Pod Leads to ensure uniform execution across all pods.

• Plan task batches, delegate responsibilities, and track daily throughput against specific phase targets.

• Ensure that task batches fulfill Google's standards for volume, technical complexity, quality benchmarks, and delivery schedules.

• Conduct weekly client reporting, communicate progress updates, provide delivery forecasts, and proactively highlight risks or dependencies.

• Identify and escalate issues related to tooling, rate limits, safety blocks, staffing challenges, and other delivery risks.

• Collaborate directly with Google to clarify requirements and align on task scope, timelines, task volume, and any changes in difficulty.

• Perform final reviews of security tasks, ensuring technical accuracy, reproducibility, and resilience against gaming or superficial solutions.

• Train and calibrate Pod Leads on CWE classification, verifier robustness, task complexity, technical quality, and acceptance criteria.

• Conduct interviews and make hiring decisions aligned with approved role requirements and project capacity needs.

• Identify high-performing Trainers and facilitate their development and promotion into Pod Lead roles.

• Predict headcount needs using throughput, workload, and quality metrics.

• Initiate hiring campaigns roughly three weeks prior to anticipated capacity needs.

• Utilize dashboards, performance metrics, and operational indicators to inform delivery strategies and staffing plans.


⛳️ Requirements

• Over 10 years of professional software engineering experience, with a robust background in software security.

• Proven track record of leading technical teams to achieve measurable delivery, quality, and scheduling goals.

• Strong knowledge of CWE, CVE, and OWASP Top 10 across various programming languages and software ecosystems.

• Demonstrated experience in reproducing software vulnerabilities, reviewing security patches, and assessing proof-of-vulnerability tests.

• Experience in designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environments.

• Strong proficiency in at least one major programming language, such as Python, JavaScript / TypeScript, Java, C / C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.

• Familiarity with Git, Linux, Bash, Docker, and standard software security tools.

• Ability to leverage dashboards, throughput metrics, quality data, and operational reports to make informed delivery and staffing decisions.

• Experience in managing or mentoring technical teams, including assigning tasks, reviewing outputs, providing feedback, and developing team leads.

• Exceptional written and verbal communication skills, with the ability to articulate technical risks and project status to clients and internal stakeholders.

• Strong organizational and prioritization abilities, capable of managing multiple pods, competing priorities, and delivery phases simultaneously.


🏝️ Benefits

• Comprehensive health and wellness benefits.

• Opportunities for professional development and continuous learning.

• Flexible work arrangements and a supportive work environment.

People also viewed

EX Squared2 days ago

Engineering Manager – Backend, Data & AI

BR flagBrazil OnlyFreelanceSoftware Engineering Manager
ApplyView job
Lattice2 days ago

Engineering Manager – Product Engineering

US flagUnited States OnlyFull-timeSoftware Engineering Manager$187.5k – $234.5k/year
ApplyView job
Unanet2 days ago

Manager, Software Engineering

US flagUnited States OnlyFull-timeSoftware Engineering Manager$175k – $185k/year
ApplyView job
CVS Health2 days ago

Senior Engineering Manager

US flagUnited States OnlyFull-timeSoftware Engineering Manager$106.6k – $284.3k/year
ApplyView job
Akamai Technologies2 days ago

Engineering Manager – Akamai Inference Cloud

PL flagPoland OnlyFull-timeSoftware Engineering Manager
ApplyView job
Gcore2 days ago

Engineering Manager

CY flagCyprus, +3 more countriesFull-timeSoftware Engineering Manager
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers