Technical Program Operations Lead – AI Engineering

This is a fully remote position, open to applicants in India, +5 more countries.

📋 Description

• Take ownership of the complete program delivery process, encompassing scope, timelines, quality, throughput, contributor performance, and cost management.

• Design and oversee workflows for coding datasets, agentic trajectories, reinforcement learning environments, benchmarks, and rubric-based evaluations.

• Identify operational inefficiencies and enhance workflows via improved instructions, sequencing, incentives, review systems, and capacity planning.

• Specify contributor requirements and collaborate with talent teams to source, evaluate, onboard, train, and ramp up distributed software engineers.

• Establish team-lead and reviewer frameworks for programs that involve 100–1,000+ contributors.

• Manage quality control systems and analyze datasets to uncover trends, systematic errors, and root causes.

• Serve as the main customer liaison for AI labs, providing updates on progress, risks, quality trends, and recovery strategies.

• Transform research objectives into practical task specifications and challenge requirements when they may not yield the intended evaluation signal.

• Utilize Python, SQL, or similar tools for automating quality sampling, defect analysis, throughput reporting, and operational assessments.

• Turn effective workflows into reusable playbooks, quality controls, evaluation assets, and contributor management systems.

• Disseminate operational insights and mentor other program leaders.

⛳️ Requirements

• Demonstrated experience in leading complex, multi-stakeholder programs within software engineering, technical program management, consulting, finance, startups, operations, or related fields.

• Exceptional analytical and problem-solving abilities, including the capacity to pinpoint bottlenecks, establish meaningful metrics, and enhance production performance.

• Experience in managing distributed teams, contributor networks, marketplaces, or extensive technical operations.

• Strong customer-facing communication skills, with a focus on managing expectations, conveying risks, and nurturing long-term client relationships.

• Proficiency in reading and reviewing code, understanding test suites, and independently evaluating technical work.

• Familiarity with at least one programming language, such as Python, TypeScript, Java, or Go.

• Experience in leveraging data and operational metrics to track quality, throughput, performance, and delivery.

• Capability to function effectively in environments where research requirements and priorities change rapidly.

🏝️ Benefits

• Competitive salary and comprehensive benefits package.

• Opportunities for professional growth and development.

• Collaborative and innovative work environment.

• Flexible work arrangements and remote work options.