Principal Data Scientist

This is a fully remote position, open to applicants in United States.

📋 Description

• Define how experimentation is performed and how data science guides product strategies.

• Connect software vendors with appropriate buyers through G2 products, which include advertisements, reviews, and agentic evaluations.

• Collaborate with stakeholders to upgrade existing products and create new offerings in a privacy-conscious, AEO-driven environment.

• Develop models, design auctions, and implement production systems as a hands-on contributor.

• Mentor team members and promote data science best practices throughout the organization.

• Oversee the experimentation standards for G2 and G2 Digital Markets.

• Streamline practices into a documented methodology that encompasses experiment design, randomization, metrics, safeguards, sample sizes, durations, and interpretations.

• Collaborate with engineering teams on instrumentation, assignment, and platform functionality.

• Outline comprehensive experimentation capability requirements, including platform, telemetry, metric layers, analysis tools, review processes, and organizational practices.

• Create methods suited to varying traffic volumes and decision-making speeds.

• Assess and implement modern experimentation techniques.

• Educate stakeholders in product, engineering, and business sectors on data science.

• Enhance the quality of experiment result interpretation and communication.

⛳️ Requirements

• 8+ years of relevant experience in data science, applied statistics, or a closely related field, with significant emphasis on experimentation; or a PhD in a quantitative discipline along with 6+ years of experience.

• Profound knowledge in experimental design and causal inference.

• Practical understanding of failure modes in online controlled experiments, including power and sensitivity analysis, variance reduction, multiple testing corrections, and heterogeneous treatment effects.

• Proficient in both frequentist and Bayesian methodologies.

• Proven experience in designing experimentation methodologies for real products.

• History of establishing technical standards that have been adopted by other teams.

• Experience in influencing engineering partners without formal authority.

• Strong practical experience with time series and large-scale web/behavioral data.

• Proficient in Python and SQL.

• Comfortable working with modern data ecosystems such as Snowflake, Spark, Airflow, and dbt.

• Excellent written and verbal communication skills.

• Authorized to work in the United States without restrictions; sponsorship questions will be included in the application.

• Preferred: 10+ years of relevant experience.

• Preferred: hands-on experience with contemporary inference methods in production settings.

• Preferred: experience in low-traffic experimentation and quasi-experimental methods.

• Preferred: experience with interference, network effects, or experimentation in two-sided marketplaces.

• Preferred: experience in technical leadership, mentoring, and design/analysis reviews.

• Preferred: experience in ML or LLM evaluation.

• Preferred: publications, contributions to open-source projects, or participation in conferences.

• Preferred: PhD in a quantitative discipline or MS in a STEM field.

🏝️ Benefits

• Flexible work arrangements.

• Generous parental leave policies.

• Unlimited paid time off (PTO).

• A fair and inclusive workplace environment.

• Opportunities for professional growth supported by a company-wide career framework.

• Human oversight in hiring decisions.

• Option to opt out of AI-assisted application reviews without any disadvantages.