
Staff Analyst, AI
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in United States.
• Act as a strategic analytics collaborator for teams developing and managing Hims & Hers AI products, such as patient-facing AI chat assistants and internal AI tools for care teams.
• Offer thought leadership and strategic support to stakeholders involved in AI Product initiatives.
• Shape the roadmap and investment strategies by leveraging data-driven insights into the performance of AI products.
• Oversee the experimentation strategy for AI product launches and iterations, which includes test design, defining success metrics, estimating sample sizes, setting guardrails, and interpreting results.
• Utilize causal inference and quasi-experimental methodologies to evaluate the impact of AI on retention as well as clinical and operational outcomes.
• Define, validate, and manage metrics frameworks and measurement plans for emerging AI product use cases.
• Implement pre-launch instrumentation and conduct post-launch evaluations within a complex, multi-source data landscape.
• Collaborate with ML/Applied AI teams to assess model performance in a production environment.
• Convert model-level signals into actionable product and business metrics.
• Conduct commercial impact assessments, including cost savings, handle-time efficiency, support deflection, and retention/churn addressability sizing.
• Work alongside AI/ML Engineering, Analytics Engineering, and Data Engineering teams to ensure tracking requirements and data integrity across AI product pipelines and event schemas.
• Employ Python or R in combination with SQL to create scalable analytical solutions.
• Design user-friendly Looker dashboards to enhance self-service capabilities across Product and Care Operations teams.
• Perform in-depth analyses and user/session segmentation to pinpoint performance improvement and opportunity areas.
• Propose clear action items based on analyses of AI product performance.
• Advocate for data quality, documentation, and consistency in deliverables across dbt models and BigQuery tables.
• Mentor junior analysts in the team.
• Report directly to the Manager of AI Analytics.
• Minimum of 8 years in analytics, data science, or a related quantitative discipline.
• Bachelor's degree in Statistics, Mathematics, Economics, Computer Science, Engineering, or a related field.
• At least 5 years of experience in designing, executing, and analyzing A/B tests, preferably including tests related to AI/ML-driven product experiences.
• Proven experience collaborating with ML teams to assess model outputs and translate these into product and business metrics.
• Significant experience working with data engineering and analytics engineering teams, particularly with dbt-modeled production pipelines.
• Strong foundation in experimental design and statistical inference.
• Proficient in employing causal inference techniques beyond standard A/B testing, such as quasi-experimental methods or observational study designs.
• Familiarity with subscription-based business models and metrics, including cohort analysis, retention/churn analysis, and addressability sizing.
• Expertise in SQL; experience with BigQuery is preferred.
• Advanced skills with Looker or Tableau.
• Ability to articulate technical analyses clearly to non-technical stakeholders, including senior leadership.
• Experience in shaping and influencing product strategy.
• Proactive mindset with a strong sense of ownership, organizational, and prioritization skills.
• Preferred: Experience in assessing conversational AI or LLM-based products.
• Preferred: Knowledge of telehealth concepts or subscription-based healthcare models, including clinical safety considerations in AI-assisted workflows.
• Preferred: Experience with GrowthBook or similar experimentation platforms.
• Preferred: Familiarity with survival analysis or time-to-event modeling, including lifelines, pyfixest, or statsmodels.
• Preferred: Experience with dbt, Airflow, and Databricks.
• Must be legally authorized to work in the U.S. without restrictions for any employer.
• Must not require immigration sponsorship from Hims & Hers to work in the U.S.
• Competitive salary and equity compensation for full-time positions.
• Unlimited paid time off (PTO).
• Company holidays.
• Quarterly mental health days.
• Comprehensive medical, dental, and vision benefits.
• Parental leave.
• Employee Stock Purchase Program (ESPP).
• 401k benefits with employer matching contributions.
• Offsite team retreats.
• Flexible and remote work options.
• Reasonable accommodations for qualified individuals with disabilities and disabled veterans.
Mercor
Vehlo
Lifebit
Mercor
Get handpicked remote jobs straight to your inbox weekly.