Staff Data Scientist

This is a fully remote position, open to applicants in India.

📋 Description

• Utilize NLP and large language models to analyze call, chat, and session transcripts.

• Derive structured and dependable signals from unstructured speech and text data.

• Establish conversation quality benchmarks and convert them into validated metrics.

• Develop LLM evaluation techniques employing reference datasets, rubrics, model-assisted reviews, and human assessments.

• Create models for classification, extraction, scoring, and summarization.

• Examine the relationships between conversation behaviors and metrics such as conversion, resolution, and retention.

• Collaborate with engineering teams to transition models from prototypes to production.

• Oversee and retrain models to ensure sustained reliability.

• Design and evaluate experiments aimed at determining business impact.

• Work alongside Data Engineering and Analytics Engineering to develop governed, reusable lakehouse tables.

• Communicate insights and recommendations to both business and technical stakeholders.

• Leverage AI for tasks including code generation and review, experiment analysis, transcript exploration, and documentation while adhering to privacy and security protocols.

⛳️ Requirements

• A Master’s degree in Computer Science, Statistics, Mathematics, Computational Linguistics, or a related quantitative discipline is mandatory; a PhD is highly regarded.

• Over 6 years of experience applying data science or machine learning within tangible products.

• Proven track record of taking at least one system from concept to production and maintaining its usage.

• Proficient in natural language processing and large language models, including prompt design, structured extraction, fine-tuning, or retrieval techniques.

• Direct experience in evaluating LLM systems utilizing reference datasets, rubrics, model-assisted reviews, human reviewers, inter-rater agreement, and regression testing.

• Strong command of Python, particularly with libraries like pandas, scikit-learn, and PyTorch or equivalent.

• Advanced SQL skills in a modern warehouse or lakehouse environment.

• Familiarity with tools such as Starburst Galaxy (Trino), Iceberg, dbt Cloud, Snowflake, BigQuery, Databricks, or Athena.

• Experience with leading LLM APIs, including Anthropic Claude or OpenAI.

• Understanding of production costs, latency, and privacy considerations.

• Familiarity with speech-to-text outputs, speaker attribution, long-context summarization, PII management, and transcription inaccuracies.

• Skills in experimentation and causal inference.

• Capability to convey findings to non-technical business leaders and develop measurable definitions.

• Experience with Git-based development, code reviews, and CI/CD processes.

• Familiarity with AI-native productivity tools such as Cursor, Make, Supabase, Netlify, Claude Code, n8n, Firecrawl, ChatGPT, Grok, Bolt, or Vercel.

• Alignment with Nerdy’s non-partisan, mission-driven culture.

🏝️ Benefits

• Competitive USD-Benchmarked Compensation: Enjoy a market-leading salary determined in U.S. dollars, disbursed in your local currency.

• 100% Remote (Home Country Only): Work from any location within your home country—no need for relocation or crossing borders.

• Flexible Time Off.

• Local Holiday Pay.

• Complimentary, all-inclusive learning membership for you and your household, featuring 1-on-1 tutoring hours, unlimited on-demand classes, and access to Nerdy’s educational products and services.

• Exclusive access to state-of-the-art AI tools.

• Ongoing training and peer review opportunities.

• A feedback-rich, collaborative work environment.

• An opportunity to make a meaningful contribution to a global learning platform.