Senior Data Scientist II

This is a fully remote position, open to applicants in Washington.

📋 Description

• Create and deploy AI sub-agents that operate throughout the customer journey, integrating predictive models, retrieved context, and LLM reasoning to provide recommendations or take actions.

• Develop predictive and prescriptive models that empower these sub-agents to address issues like churn risk, growth, adoption pathways, account health scoring, and other lifecycle challenges.

• Establish the data foundations and knowledge layers for the sub-agents to reason upon, ensuring responsible aggregation and privacy-conscious design.

• Design the tools, retrieval methods, and grounding strategies utilized by each sub-agent; determine when a sub-agent should act, recommend, defer, or escalate.

• Create evaluation frameworks that assess when a sub-agent is ready for deployment and detect regressions in production environments.

• Define metrics and experimentation strategies for sub-agent rollouts; evaluate real customer impact rather than just offline accuracy or evaluation scores.

• Collaborate with Product, Engineering, and Applied AI teams from problem definition to production implementation.

• Foster a culture of data and modeling within Product and Engineering, while mentoring fellow data scientists on the team.

⛳️ Requirements

• Bachelor’s degree with 8+ years of experience (or 10+ years); an advanced degree in a quantitative discipline (Statistics, CS, ML, Economics, Operations Research, or a related field) is preferred.

• Extensive applied ML expertise encompassing both traditional machine learning and deep learning: gradient boosting, regularized linear models, transformer-based sequence models, foundation model embeddings, causal ML, contextual bandits, and offline reinforcement learning.

• Strong understanding of causal inference for intervention design and lifecycle modeling, including uplift modeling, difference-in-differences, propensity scoring, and synthetic control.

• Solid grounding in statistics and experimental design: hypothesis testing, power analysis, multiple comparisons, sequential testing, and quasi-experimental methods.

• Practical experience in deploying LLM- and agent-based systems to production: tool application, retrieval, multi-step reasoning, evaluation, and establishing guardrails.

• Experience managing ML in production environments, including feature engineering and pipelines, model monitoring, drift detection, retraining schedules, and understanding the trade-offs between batch and real-time serving.

• Proficient in SQL and Python; comfortable with ML/LLM tools at scale (Spark, Databricks, Snowflake, or similar), ML frameworks (PyTorch, scikit-learn, XGBoost/LightGBM), and visualization tools (Tableau or analogous).

• Experience modeling the customer lifecycle—churn, expansion, adoption, plan health, lead/account scoring—and business fluency in the SaaS metrics that influence it (NRR, GRR, ARR, and cohort economics).

• A practical approach to production standards: latency, cost, monitoring, drift, hallucinations, and the implications of model or sub-agent errors.

• Proven ability to build effective cross-functional relationships and communicate analyses clearly to both technical and executive audiences.

• Capability to research and master new technologies, tools, and methodologies, thriving in a dynamic environment by identifying opportunities and executing independently or collaboratively.

🏝️ Benefits

• Employer-subsidized medical, vision, and dental coverage for full-time employees.

• 401k Match to assist in saving for your future (50% of your contribution up to the first 6% of your eligible pay).

• Monthly stipend to enhance your work and productivity.

• Flexible Time Away Program, in addition to Sick Time Off.

• US employees automatically receive Smartsheet-sponsored life insurance, as well as short-term and long-term disability plans.

• US employees are entitled to 12 paid holidays each year.

• Up to 24 weeks of Parental Leave.

• Personal paid Volunteer Day to engage with and support our community.

• Opportunities for professional growth and development, including access to Udemy online courses.

• Company-funded perks, such as a counseling membership, local retail discounts, and your personal Smartsheet account.

• Telecommuting options from any registered location in the U.S. (specific to the role).