Technical Training & Quality Manager

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement technical training programs for AI data and annotation teams.

• Create training curricula, learning paths, assessments, certification programs, and refresher modules.

• Educate teams on AI/ML concepts, LLMs, Generative AI, NLP, data annotation, data labeling, model evaluation, prompt engineering, RLHF, and AI response quality.

• Conduct Train-the-Trainer initiatives and develop internal technical trainers.

• Identify skill deficiencies and devise targeted upskilling plans.

• Create practical exercises, technical assessments, simulations, and certification frameworks.

• Oversee quality frameworks and standards across AI data projects.

• Define and track quality KPIs, accuracy, agreement rates, defect rates, audit scores, rework, and productivity metrics.

• Establish quality calibration processes and perform regular quality audits.

• Analyze quality trends, diagnose root causes, and implement corrective and preventive measures.

• Foster continuous improvement to enhance accuracy, consistency, productivity, and turnaround time.

• Provide technical guidance for data annotation, LLM evaluation, RLHF, prompt-response evaluation, NLP, multimedia annotation, Generative AI evaluation, data validation, model benchmarking, and red teaming projects.

• Convert project guidelines, client specifications, annotation taxonomies, and evaluation rubrics into training and quality initiatives.

• Collaborate with SMEs and technical teams to address complex quality and interpretation challenges.

• Work alongside clients, Program Managers, Operations, Engineering, Data Science, and QA teams.

• Participate in client calibration sessions and quality reviews.

• Present quality dashboards, training effectiveness, RCA findings, and improvement proposals to senior leadership.

• Support new project launches through training needs assessments, SOP development, quality framework establishment, and readiness evaluations.

• Measure training ROI and quality enhancements using data and analytics.

• Propel automation and technology integration in training and quality processes.

• Standardize best practices across various projects and delivery teams.

⛳️ Requirements

• 8–12 years of experience in AI/ML, data operations, data annotation, AI training, quality management, technical L&D, or similar fields.

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, AI/ML, Statistics, or a related discipline.

• Profound understanding of Artificial Intelligence, Machine Learning, Generative AI, and LLMs.

• Experience with AI data, annotation, or model evaluation projects.

• Proven experience in managing training and quality teams in a fast-paced delivery environment.

• Strong analytical and problem-solving abilities.

• Familiarity with Root Cause Analysis, CAPA, calibration, quality audits, and process enhancement.

• Excellent stakeholder and client management capabilities.

• Outstanding communication, presentation, and facilitation skills.

• Ability to simplify complex technical concepts into accessible training materials.

• Experience with AI platforms, annotation tools, LLM evaluation frameworks, or data-quality platforms.

• Knowledge of Python, SQL, analytics/BI tools, or automation is a plus.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Opportunities for professional development and continuous learning.

• Flexible working hours and remote work options.

• Comprehensive health and wellness benefits.

• Collaborative and inclusive work environment.