Data & AI Lead

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Collaborate with a senior team, take ownership of crucial metrics, and establish the evaluation framework for an AI-driven hiring platform.

• Design and Manage Sourcing Metrics: Transform subjective product feedback into organized, quantitative signals that facilitate enhancements. Work alongside product and engineering teams to define sourcing quality metrics (relevance, match accuracy, diversity).

• Create and validate measurement frameworks from the ground up; Convert qualitative feedback into SQL-based metrics; Effectively communicate metrics and analytic reasoning across different teams; Manage the feedback → metric → business insight loop.

• Develop LLM Evaluation Systems: Establish evaluation matrices and success criteria (hallucination rates, tool accuracy, consistency); Implement evaluation frameworks utilizing Langfuse (or similar tools); Create monitoring systems, baselines, and processes for continuous improvement.

• Provide Technical Contributions: Write production-level Clojure / ClojureScript as necessary; Collaborate with senior full-stack engineers; Uphold high standards of code quality.

⛳️ Requirements

• Proficient in PostgreSQL and SQL optimization techniques.

• Experience in designing comprehensive metrics frameworks from vague requirements.

• Strong skills in data modeling.

• Familiarity with LLM systems in a production setting and evaluation methodologies.

• Preference for experience with Langfuse or similar tools for LLM operations.

• Exceptional communication skills, capable of conveying technical concepts to product and engineering stakeholders.

• Nice to Have: Experience with semantic search (embeddings, vector databases).

• Background in machine learning.

• Experience within the recruiting or HR-tech sector.

🏝️ Benefits

• Remote-first work environment with genuine flexibility.

• Competitive compensation accompanied by equity options.

• Provision of all necessary tools at our expense.

• Autonomy to fully own your area of expertise.

• Minimal oversight with a focus on delivering impact.