Head of Trust & Safety

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Take responsibility for the safety of AI outputs for educators and students, encompassing policy development, model-level safeguards, evaluations, red-teaming, and incident management.

• Manage the trust relationship with school districts through the creation of safety documentation, responses to RFPs and school board inquiries, and ensuring compliance with state AI-in-education regulations.

• Create safety evaluations and monitoring as essential components of product infrastructure.

• Guarantee that each new tool incorporates safety acceptance criteria during the scoping phase rather than at the launch stage.

• Oversee student-facing safety aspects, including age-appropriate content, handling of self-harm and crisis situations, and establishing escalation pathways to educators.

• Execute the entire safety incident process and ensure that postmortems inform product and engineering improvements.

• Collaborate with the Legal team on COPPA, FERPA, state privacy laws, and evolving AI regulations.

• Build and manage a small team of 1–3 members initially, with plans to expand the function through 2027.

• Work with multi-provider LLM infrastructure, moderation APIs, custom classifiers, evaluation and red-team tools, observability, and incident management systems.

⛳️ Requirements

• Previous experience in trust & safety or responsible AI for a consumer or youth-focused product at scale.

• Hands-on expertise with LLM safety, including evaluations, classifiers, prompt/system-level safeguards, and red-teaming activities.

• Proven ability to enhance safety as a velocity enabler by integrating guardrails into the infrastructure.

• Capable of making judgment calls in ambiguous situations and taking public ownership of those decisions.

• Strong writing skills for safety documentation, district-facing explainers, and incident communication.

• Operates with a hypothesis-first approach and quickly escalates one-way doors.

• Experience in managing live incidents involving minors or vulnerable populations.

• Demonstrated ability to build safety as a fundamental part of product infrastructure rather than as a barrier.

• Proficient in articulating safety trade-offs clearly to executive and district-level stakeholders.

• Familiarity with state AI-in-education frameworks and district procurement processes.

• Data/ML fluency to collaborate effectively with engineering on classifiers and evaluation pipelines.

• Comfortable representing safety at conferences, engaging with the press, and presenting before district boards.

• No specific educational qualifications required.

🏝️ Benefits

• Flexibility to work from home.

• Unlimited time off policy.

• Employer-funded health insurance options.

• Affordable dental and vision plans.

• Generous stock options, vested over a four-year period.

• 401k matching program.

• Monthly wellness stipend.