Senior AI Engineer

This is a fully remote position, open to applicants in United States, +2 more locations.

📋 Description

• Design, develop, and deliver end-to-end product experiences based on large language models (LLM).

• Create conversational coaching and agentic workflows that facilitate multi-step tasks.

• Construct tool-use and orchestration layers.

• Develop coaching and career-pathway products informed by observed career transitions and causal evidence regarding wages and lifetime earnings.

• Determine the capabilities and limitations of labor-market and intervention data.

• Build evaluation frameworks, conduct offline and online quality assessments, track regressions, and implement human-in-the-loop reviews.

• Develop predictive, classification, and ranking models when relevant.

• Prepare, label, manage, and sustain AI data pipelines and knowledge repositories.

• Safely connect AI systems to internal tools, databases, SaaS products, case management systems, and enterprise workflows.

• Implement authentication measures, guardrails, and handling for failures.

• Collaborate with Engineering, Product teams, and the VP of Data & AI.

• Contribute to the development of AI prompting, evaluation, agent permissions, and technical frameworks.

• Provide technical leadership while creating new products.

⛳️ Requirements

• Approximately 5+ years of substantial applied machine learning/artificial intelligence engineering experience.

• Proven track record of deploying systems into actual products utilized by end users.

• Experience in production environments developing and delivering LLM-based features.

• Proficiency in prompt engineering, agentic workflows, tool utilization, function calling, retrieval, and orchestration.

• Experience in creating evaluations, quality metrics, regression tracking, and human-in-the-loop review processes for LLM systems.

• Strong foundation in machine learning principles and hands-on experience with predictive or classification models.

• Proficiency in Python and SQL.

• Experience with ingestion and transformation pipelines, labeling, managing knowledge sources, and data governance.

• Familiarity with integrating APIs, databases, SaaS platforms, third-party data providers, and enterprise systems.

• Understanding of safety protocols and guardrails in sensitive domains.

• Ability to articulate models, agent behavior, evaluation outcomes, and trade-offs to non-technical audiences.

• Experience with AWS and SageMaker is an advantage.

• Background in jobs-and-skills, HR, labor market data, O*NET, or ESCO is a plus.

• Experience with case management, government systems, recommender systems, ranking, search, RAG, labor economics, program evaluation, publications, talks, blogs, or open-source projects is a plus.

• Note that formal education is not a primary focus, and a credential is not required.

🏝️ Benefits

• Remote work opportunities available throughout the US and Canada.

• Hybrid office access for candidates located in Toronto and New York City.

• Opportunities for quarterly off-site and team gathering travel.

• Reasonable accommodations for disabilities during the application process, interviews, and employment.

• Commitment to an equal opportunity and inclusive workplace.

• Human-reviewed, equitable AI-supported hiring processes.