ML Engineer – Trust & Safety

This is a fully remote position, open to applicants in Canada, +1 more country.

📋 Description

• Take ownership of content moderation from start to finish, encompassing everything from children's speech to printed images, including copyrighted and licensed characters.

• Develop and enhance safety evaluation suites to assess when updates to models, prompts, or thresholds are ready for deployment.

• Continuously refine classifiers and determine the optimal integration of in-house and third-party models.

• Adjust moderation practices to minimize over-blocking while maintaining robust protection.

• Conduct ongoing red teaming efforts on models and the moderation pipeline.

• Oversee review tools for flagged content and parent reports.

• Manage the incident response runbook related to safety concerns.

• Ensure compliance obligations are met from a technical standpoint, including data retention and deletion protocols.

• Collaborate with ML and Backend/Platform engineers to incorporate safety measures into new models and features prior to their launch.

⛳️ Requirements

• Practical experience in safety engineering with products that serve real users.

• Proven experience in developing evaluations or classifiers for harmful content, beyond merely configuring a vendor API.

• Proficient software engineering skills in Python.

• Capability to deploy production-ready code in the moderation workflow that is both efficient and reliable.

• Familiarity with precision and recall trade-offs.

• Sound judgment in establishing thresholds when both types of errors have associated costs.

• Ability to maintain good judgment in high-pressure situations.

🏝️ Benefits

• Opportunities for growth and career advancement.

• Flexible working hours.

• A culture of innovation, collaboration, and enjoyment.

• Comprehensive benefits package.

• Additional enjoyable perks!

• An accessible and inclusive hiring process.

• Reasonable accommodations available for applicants.