Trust & Safety Lead, Education

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of safety on Playlab’s platform, emphasizing the protection of children and young adults.

• Make informed decisions regarding live incidents, moderation escalations, and safety policies.

• Develop systems that can automatically identify issues and determine when human evaluation is necessary.

• Assess flagged content, investigate overlooked misuse, and conduct stress tests on features prior to and following their launch.

• Foster a community comprising internal and partner testers.

• Establish a Playlab-specific harm taxonomy along with labeling guidelines.

• Generate labeled datasets for engineering detection and testing purposes.

• Define requirements for filters, rules, and signals, and assess system efficiency.

• Monitor automated detection rates, false positives, and detection timing.

• Oversee incident response from initial triage and investigation through to action, communication with schools, necessary reporting, and post-incident evaluations.

• Create urgent intake and escalation pathways in collaboration with Support.

• Draft and uphold safety and moderation policies.

• Evaluate safety risks associated with new features prior to their launch.

• Collaborate with school and district leaders on safety-related issues.

• Develop incident-reporting processes, training, and resources for educational partners.

• Translate incident and review patterns into actionable insights for the product roadmap.

• Monitor incident frequency, response times, policy adherence, and trends; report findings to leadership.

• Report directly to the CTO and work in conjunction with product, engineering, learning engineering, partnerships, responsible AI, privacy, and security teams.

⛳️ Requirements

• A minimum of 5 years of experience in trust & safety.

• Proven experience as a decision-maker during high-stakes escalations in real-time.

• Background in safety-related work involving young individuals, including disclosures of self-harm or abuse, inappropriate contact, CSAM reporting, or similar scenarios.

• Expertise in designing automated systems for problem detection, including establishing labeling guidelines, filter requirements, and conducting effectiveness evaluations.

• Experience in creating trust & safety operations such as intake forms, triage rubrics, runbooks, training materials, and dashboards.

• Capability to compose principled and practical safety policies.

• Strong judgment under pressure with the ability to articulate decisions clearly.

• Excellent communication skills with school leaders, engineers, and learning partners, including in asynchronous and remote settings.

• A passion for student wellbeing, equity, access, and the safe use of AI in education.

• Bonus: hands-on experience with generative AI failure testing.

• Bonus: experience in AI red teaming, evaluations, or adversarial testing.

• Bonus: proactive investigations or abuse hunting experience.

• Bonus: familiarity with user-generated content or creator-tool platforms.

• Bonus: knowledge of FERPA, COPPA, state student data privacy regulations, and mandated reporting procedures.

• Bonus: experience in classroom settings, school leadership, counseling, or edtech.

• Bonus: a track record of building trust & safety operations from the ground up in a startup or nonprofit environment.

🏝️ Benefits

• Healthcare fully covered for you and 80% for your dependents.

• Dental and vision coverage at 100% for you and your dependents.

• Retirement plans available.

• Life and AD&D insurance provided.

• Monthly wellness stipend offered.

• Budget for home office setup.

• Provision of a new laptop.

• Generous time-off policy.

• Opportunities for professional development.

• Flexible remote-first working environment with both autonomy and collaboration.