Senior Web Experimentation Manager

This is a fully remote position, open to applicants in Canada, +1 more country.

📋 Description

• Lead the experimentation roadmap by prioritizing ideas based on traffic, anticipated impact, and costs.

• Establish and uphold testing standards, including sizing, statistical power, minimum detectable effect, guardrail metrics, and guidelines for launching, iterating, or discontinuing tests.

• Evaluate test designs prior to launch and assess results before dissemination.

• Create, develop, and conduct significant experiments, particularly focusing on pricing and homepage elements.

• Manage the health and measurement of the testing platform in collaboration with web development and analytics teams.

• Keep the experiment record as the definitive source of truth and translate results into strategic web recommendations.

• Present program outcomes to marketing leadership.

• Mentor contributors across web, design, and marketing on hypotheses, test design, and result interpretation.

• Work together with web strategy, web development, design, product marketing, and analytics partners.

• Define the roadmap for the experimentation program and establish decision-making rules for high-traffic website pages.

⛳️ Requirements

• 6–9 years of experience in conversion optimization, web experimentation, growth marketing, or a similar field, including managing an experimentation program across various pages or products.

• Extensive experience with a testing platform like Optimizely, VWO, or a comparable tool, covering program-level setup and governance.

• Strong understanding of experiment statistics, including power and sample size, minimum detectable effect, false positive control, guardrail metrics, sample ratio mismatch, and the implications of peeking and multiple comparisons.

• Capability to assess a test's design and validity and articulate why a result should or should not be trusted.

• Proficiency in HTML, CSS, and JavaScript to create and debug client-side variations.

• Working knowledge of SQL and an analytics tool like GA4, sufficient to independently validate results outside of the testing platform.

• Good judgment regarding when an experiment is appropriate and when a low-risk, reversible change can be implemented without one.

• Excellent writing and communication skills, with the ability to present results and trade-offs to senior stakeholders.

• Experience in coaching or mentoring others in experimentation.

• Comfort in a remote-first, asynchronous work environment.

🏝️ Benefits

• An inclusive and flexible environment that allows you to be your authentic self.

• A competitive total compensation package featuring a base salary, an equity incentive plan, and variable commission for quota-based roles.

• Comprehensive group benefits with no waiting period, including health, vision, dental, and more for you and your family.

• Remote-first work environment.

• Opportunities for virtual and in-person social events.

• Corporate co-working program available.

• Employer-funded retirement contributions matching dollar-for-dollar, up to a maximum annual employer contribution of 0.75% of eligible compensation.

• Annual company retreat and team off-sites.

• $1500 USD annually allocated for professional development.

• Access to mentorship, coaching, and internal promotion opportunities.

• Flexible paid time off policy.

• Company-issued laptop (Mac or PC).

• Monthly reimbursement for home internet costs.

• $500 USD workstation customization allowance.

• Paid parental leave top-ups: 20 weeks for birthing parents and 16 weeks for non-birthing parents.