Human Data Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement comprehensive data workflows — from task conception through quality assurance and delivery — ensuring that each phase generates data that is appropriately structured for its intended post-training usage (e.g., SFT, RL, model evaluation).

• Create data collection architectures and task frameworks that effectively translate client requirements from a model into concrete, scalable data generation strategies.

• Develop and oversee data quality frameworks that proactively identify issues before they reach the client.

• Collaborate with engineering and product teams to enhance data pipelines, pinpointing areas where structural or methodological adjustments can boost throughput without compromising quality.

• Convert trends in data quality and project architecture into actionable insights that guide project design, client deliverables, and product evolution.

⛳️ Requirements

• Proven experience in designing large-scale human data collection — for instance, in computational cognitive science, HCI, crowdsourcing research, or a related domain where you have meticulously considered how to derive reliable signals from human participants.

• Understanding of ML post-training frameworks (e.g., SFT, RL) and a foundational intuition regarding how data quality decisions impact model performance.

• Strong technical proficiency with the capability to navigate data pipelines, not just assess endpoints.

• Systems-level thinking — you grasp how task design decisions influence training data and design accordingly.

• Exceptional communication abilities — you can articulate measurement concepts to engineers and convey engineering constraints to researchers.

🏝️ Benefits

• Competitive salary

• Flexible working hours

• Professional development budget

• Home office setup allowance

• Global team events