
Project Manager, Applied AI
Posted 1 day ago

Posted 1 day ago
• Oversee the entire lifecycle of AI data projects, from establishing scope and creating guidelines to delivering data and conducting post-mortem analyses.
• Supervise extensive data pipelines for the collection of multilingual data (audio, text, image) as well as LLM evaluation (RLHF, SFT, ranking, and safety testing).
• Diligently track and report on critical performance indicators, such as throughput, quality, and productivity.
• Maintain dashboards to display project health and identify bottlenecks in real-time.
• Cultivate partnerships with data specialists and crowd pools, ensuring compliance with SLAs related to localized nuances and linguistic precision.
• 3-5+ years of experience in project management, particularly within AI/ML data operations.
• Comprehensive understanding of LLM training procedures (Pre-training, SFT, RLHF) and evaluation techniques (Human-in-the-loop, red teaming).
• Advanced skills in Excel/Google Sheets, with the capability to write SQL queries for performance data extraction and analysis.
• Proven experience utilizing Agile, Scrum, or Kanban methodologies to manage intricate workflows.
• Outstanding ability to draft clear and unambiguous guidelines for multilingual audiences.
• Proficiency in a second language is highly advantageous.
• Familiarity with data annotation platforms (e.g., Scale AI, Super Annotate) and project management tools (e.g., Jira).
• Educational background in ML Engineering, Computer Science, Data Science, and Project Management training.
• Competitive salary and performance-based bonuses.
• Opportunities for professional growth and development.
• Flexible work hours and remote work options.
• Comprehensive health and wellness benefits.
• Collaborative and inclusive work environment.
Avalere
BerryDunn — Assurance, Tax and Consulting
Verity Group
Marketing Pros
Get handpicked remote jobs straight to your inbox weekly.