Senior Web Experimentation Manager

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Take charge of the experimentation roadmap for Tailscale's most visited website pages.

• Prioritize experiments considering traffic, anticipated impact, and associated costs.

• Establish and uphold testing standards, which encompass sizing, statistical power, minimum detectable effect, guardrail metrics, and decision rules.

• Evaluate test designs prior to launch and assess results before dissemination.

• Design, develop, and execute significant experiments, particularly concerning pricing and homepage elements.

• Oversee the health of the testing platform and measurement in collaboration with web development and analytics teams.

• Keep the experiment record as the definitive source for website insights.

• Transform experiment outcomes into strategic recommendations for the web.

• Present program outcomes to marketing leadership.

• Mentor contributors across web, design, and marketing in hypotheses, test design, and result interpretation.

⛳️ Requirements

• 6–9 years of experience in conversion optimization, web experimentation, growth marketing, or a related discipline, with responsibility for an experimentation program spanning multiple pages or products.

• Extensive experience with a testing platform such as Optimizely, VWO, or a similar tool, including program-level setup and governance.

• Strong understanding of experiment statistics, including power and sample size, minimum detectable effect, false positive control, guardrail metrics, sample ratio mismatch, and the risks associated with peeking and multiple comparisons.

• Capability to assess test design and validity, articulating reasons for trusting or questioning results.

• Proficiency in HTML, CSS, and JavaScript for building and debugging client-side variations.

• Working knowledge of SQL and analytics tools like GA4.

• Sound judgment regarding when experimentation is appropriate and when changes can be implemented without testing.

• Excellent writing and communication skills for effectively presenting results and trade-offs to senior stakeholders.

• Experience in coaching or mentoring others on experimentation practices.

• Comfort in a remote-first, asynchronous work environment.

🏝️ Benefits

• Competitive base salary, equity incentive plan, and variable commission for quota-based roles.

• Comprehensive health, vision, and dental coverage with no waiting period.

• Flexible remote-first work culture.

• Opportunities for virtual and in-person social events.

• Corporate co-working program available.

• Employer-funded retirement contributions matching employee contributions dollar-for-dollar, up to 0.75% of eligible compensation annually.

• Annual company retreat and team off-site events.

• $1500 USD annually allocated for professional development.

• Mentorship, coaching, and opportunities for internal promotions.

• Flexible paid time off policy.

• Provision of a company-owned laptop (Mac or PC).

• Monthly reimbursement for home internet expenses.

• $500 USD allowance for home office setup.

• Paid parental leave enhancements: 20 weeks for birthing parents and 16 weeks for non-birthing parents.

• Accommodations for accessibility and inclusive hiring practices.