
Data Scientist
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in United States.
β’ Develop evaluation datasets and tests for assessing answer quality, grounding, retrieval, and identifying failure modes
β’ Utilize Python and SQL to analyze activation metrics, product usage, and customer outcomes
β’ Evaluate trade-offs between quality, latency, and cost
β’ Design experiments with well-defined baselines and effectively communicate uncertainty
β’ Generate reproducible analyses and create insightful dashboards
β’ Collaborate with engineering teams on instrumentation and privacy-aware data management
β’ Translate findings into actionable product recommendations
β’ Review existing data and set a quality baseline for a key assistant journey
β’ Conduct a quality-versus-cost analysis that includes actionable insights
β’ Proficient in Python and SQL
β’ Solid understanding of practical statistics along with awareness of bias, leakage, and experimental constraints
β’ Demonstrated experience in evaluating AI or machine-learning systems through work, research, or projects
β’ Ability to communicate clearly and employ reproducible analytical techniques
β’ No specific educational qualification required
β’ Preferred: Knowledge in RAG, embeddings, vector search, LLM evaluation, product analytics, causal inference, monitoring, or cost analysis
β’ Full-time paid position
β’ Opportunity for remote work
β’ 40 hours of work per week
Multiplier
The Cigna Group
The Cigna Group
Native
Get handpicked remote jobs straight to your inbox weekly.