CRO Specialist

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of a dynamic testing roadmap and hypothesis backlog across paid media, email/lifecycle, landing pages, onboarding, paywall, and creative initiatives.

• Prioritize experiments using a defined framework like ICE or PIE.

• Ensure visibility into ongoing tests, insights gained, and next steps, while communicating updates on a weekly basis.

• Establish and maintain testing velocity with multiple concurrent, non-disruptive experiments.

• Design and implement A/B, multivariate, holdout, and geo-targeted experiments with appropriate controls, sample sizes, and success metrics.

• Set up and conduct quality assurance on tests directly in the experimentation platform.

• Collaborate with Data & Analytics and Engineering teams on tracking, event instrumentation, and attribution efforts.

• Define primary, secondary, and guardrail metrics for each test conducted.

• Analyze results utilizing GA4, experimentation platforms, and data from the warehouse.

• Provide structured recommendations to either launch, iterate, or discontinue each completed test.

• Convert successful results into actionable strategies for Paid Media, Lifecycle/CRM, Product, and Creative teams.

• Present findings to cross-functional stakeholders in clear, accessible narratives.

• Consolidate learnings across various channels and manage overlapping tests effectively.

• Maintain a searchable repository of testing results.

• Advocate for a test-and-learn culture through readouts, workshops, and established testing standards.

• For senior-level candidates, lead strategy development, establish standards, drive the roadmap, justify prioritization decisions, mentor others, and review test design and results.

⛳️ Requirements

• Practical experience in running A/B or multivariate tests within a marketing or growth context.

• Proficiency with at least one experimentation platform such as Optimizely, VWO, Statsig, Convert, AB Tasty, Eppo, or LaunchDarkly.

• Understanding of experimental design, control/treatment setup, sample sizing, statistical significance, and validity threats.

• Strong analytical skills with GA4, testing-platform dashboards, and Excel/Sheets.

• Ability to assess testing programs, pinpoint design issues, and implement properly instrumented experiments.

• Excellent written and verbal communication abilities.

• Daily familiarity with AI tools like ChatGPT, Claude, Cursor, or similar technologies.

• Strong discipline in execution, quality assurance, naming conventions, and documentation.

• CRO Specialist: 2–4 years of direct experience in CRO, growth marketing, experimentation, or analytical marketing.

• CRO Specialist: Proven track record in designing and executing tests in at least one channel, delivering measurable results.

• Senior CRO Specialist: 5–8+ years of hands-on experience in CRO, experimentation, or growth marketing.

• Senior CRO Specialist: Demonstrated experimentation experience across at least two channels with measurable business impact.

• Senior CRO Specialist: Comfort with SQL or data warehouse analysis.

• Senior CRO Specialist: Ability to lead strategy, set standards, drive the roadmap, defend prioritization decisions, and mentor/review others.

• Preferred: Experience in consumer subscription, marketplace, or dating/social platforms.

• Preferred: Knowledge of Bayesian methods, multi-armed bandits, or adaptive experimentation.

• Preferred: Background in behavioral economics or consumer psychology.

• Preferred: Experience in company-wide experimentation programs.

• Preferred: Experience in AI personalization or recommendation-system experimentation.

• A Bachelor's degree in a relevant field or a comparable history of delivering rigorous tests is listed under Preferred Qualifications.

🏝️ Benefits

• Health, dental, and vision insurance.

• 401(k) plan.

• Standard benefits package.

• Fully remote work available within the US.

• Direct exposure to the Director, CMO, and Co-CEOs from the outset.

• Clear career progression as testing scope, channel ownership, and program maturity expand.