Strategic Project Lead – AI Post-Training

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the complete project delivery process, which includes defining scope, managing timelines, handling budgets, staffing, and risk management.

• Facilitate client interactions, status updates, planning sessions, and escalation processes.

• Convert model enhancement goals into data specifications, workflows, rubrics, and evaluation strategies.

• Establish quality benchmarks and acceptance criteria for preference data, model comparisons, and evaluation results.

• Supervise delivery quality, identify inconsistencies, and clarify ambiguous requirements in collaboration with clients.

• Provide guidance on data architecture, evaluation methodologies, and project viability based on your expertise in the field.

• Create reusable guidelines, Standard Operating Procedures (SOPs), and Quality Assurance (QA) frameworks to enhance consistency across various programs.

• Mentor Operations Specialists while contributing to project scoping, pilot initiatives, and the development of new capabilities.

• Assist AI companies in developing and refining cutting-edge models through high-quality data initiatives.

• Collaborate with clients and internal teams to convert AI research requirements into structured workflows, dependable datasets, and quantifiable outcomes.

⛳️ Requirements

• 1–2+ years of experience in AI data operations, project coordination, or delivery, preferably in a Generative AI (GenAI) or frontier AI setting.

• Familiarity with at least one AI post-training or model evaluation process.

• Proven experience in coordinating projects or workstreams, managing stakeholders, and maintaining client communication.

• Knowledge of data quality, annotation processes, and quality assurance techniques.

• Capability to translate changing requirements into structured workflows, rubrics, and measurable quality benchmarks.

• Strong troubleshooting and organizational abilities, with a knack for managing multiple priorities effectively.

• Keen interest in the latest AI advancements, including frontier models and post-training methodologies.

• Experience with reinforcement learning from human feedback (RLHF), preference data, or model response assessment is a plus.

• Familiarity with rubric creation, model comparison, benchmark development, or evaluation generation is advantageous.

• Experience in assessing model outputs for quality, accuracy, reasoning, or adherence to instructions is beneficial.

• Exposure to AI firms, frontier AI laboratories, or model evaluation initiatives is a plus.

• Bilingual skills, especially in German or a Nordic language, are considered a plus.

🏝️ Benefits

• Permanent - Regular Full-time position.

• Option for remote work.

• Flexibility in delivery methods that suit both you and your team.

• Access to tools, resources, and development opportunities for skill enhancement.

• Chance to tackle complex AI challenges across various industries and regions.

• A collaborative culture that emphasizes innovation, curiosity, accountability, excellence, and humility.