Data & AI Program Manager

This is a fully remote position, open to applicants in Washington.

📋 Description

• Conduct thorough market and user research to comprehend data requirements and expectations across various NLP applications and domains.

• Establish data specifications, scope, and sourcing strategies tailored for each use case and domain.

• Create judgment guidelines and instructions for data annotation, validation, and quality assurance.

• Deliver datasets, schemas, guidelines, and annotations that adhere to approved specifications and sourcing criteria.

• Oversee the complete data annotation process from start to finish.

• Evaluate data quality metrics, including accuracy, consistency, coverage, and diversity.

• Execute approved actions for enhancing data quality.

• Collaborate with data engineers, data scientists, and machine learning engineers to incorporate annotated data into production workflows.

• Assist in LLM fine-tuning and assess model performance and its impact.

• Identify data gaps and opportunities; suggest new data sources, methods, and features.

• Convey data vision, strategy, and outcomes to stakeholders, including product owners, engineers, researchers, customers, and partners.

• Prepare and present data reports, presentations, and demonstrations using client-approved formats and channels.

⛳️ Requirements

• Proven experience in NLP data strategy, annotation program management, or a similar data quality/linguistics role.

• Strong grasp of data annotation workflows, guideline creation, and inter-annotator quality control.

• Familiarity with LLM training and fine-tuning pipelines, particularly how annotated data contributes to model evaluation.

• Analytical mindset with the ability to convert quality metrics into actionable improvement plans.

• Exceptional communication skills for engaging with stakeholders, including the ability to present to both technical and non-technical audiences.

• Experience in large, matrixed corporate environments.

• Customer-centric approach.

• Strong follow-through skills.

• Proficient in building Agents, managing PowerBI dashboards, SharePoint lists, and coding with tools such as Codex, Claude Code, and GitHub Copilot.

🏝️ Benefits

• Full-time W2 employment.

• Remote work option.