Senior AI/ML Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of the competency navigation algorithm that powers the Learner-Competency-Mapper, overseeing its design, implementation, and updates as real data becomes available.

• Structure the prerequisite framework of the domain and its priors to ensure the model operates effectively from a cold start and enhances as learners advance.

• Create pipelines that convert unstructured platform data into actionable insights.

• Design a constrained LLM-as-judge to evaluate the effectiveness of Chidi, including model selection, evaluation design, and understanding the potential failure modes of judges.

• Develop behavioral and at-risk profiling models that assess learners for the Grader-Competency-Pulser as feedback data from the platform accumulates.

• Expand the platform’s functionalities into authentic machine learning and data science initiatives as the data asset evolves.

⛳️ Requirements

• Extensive expertise in probabilistic/Bayesian modeling, including the ability to design models based on domain structure rather than just fitting them to existing data.

• Proficient Python skills with the capability to deliver production pipelines, beyond merely using notebooks.

• Experience in evaluation design or the acumen to swiftly create evaluation systems.

• Significant probabilistic modeling experience in structured domains such as recommenders, knowledge graphs, or causal inference.

• Thoughtful consideration of assumptions and the priors for cold-start models.

• Quick learner, capable of mastering unfamiliar domains.

• Ability to reflect on a model that was incorrect and discuss its evaluation process.

• Exposure to BKT/KST or psychometrics (desirable, not mandatory).

• Familiarity with MLflow or similar experiment tracking systems (desirable, not mandatory).

• Knowledge of knowledge graphs (desirable, not mandatory).

• A self-motivated work ethic suited for small-team and virtual collaboration.

• Regular communication through web collaboration tools and video conferencing.

• Eagerness to continuously enhance skills and obtain certifications.

🏝️ Benefits

• Opportunity for virtual working.

• Support for ongoing professional development and certification attainment.

• Engagement with colleagues and clients from various international locations.