Senior Data Scientist, Agentic UX

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of daily decisions and the definition of solutions for a particular experience area.

• Establish leading indicators, define the scope of work, prioritize tasks effectively, and make trade-off decisions that balance user needs, agent behavior, technical limitations, and business objectives.

• Keep an eye on competitive landscapes, market trends, adjacent products, and emerging AI technologies.

• Cultivate expertise in telecommunications, EV charging, renewables, utilities, and associated customer workflows.

• Analyze complex cross-team issues using logs, traces, evaluations, and customer behavior data.

• Identify unmeasured areas, design analytical approaches, determine root causes, and implement actionable findings.

• Engage directly with customers, conduct pilot programs, analyze usage data, and translate behavioral insights into design choices.

• Create comprehensive end-to-end agentic experiences, which include context architecture, decision pathways, communication flows, and behavioral agreements.

• Design experiences for both web and mobile platforms, catering to field and enterprise users.

• Deliver production code, construct AI graphs, prototypes, data pipelines, instrumentation, and evaluation frameworks.

• Architect Scout graphs and outline decision pathways, context architecture, communication flows, and product interfaces.

• Develop thorough evaluations that assess correctness, grounding, safety, refusal, latency, and tone.

• Formulate offline and online evaluation strategies and compile supporting datasets.

• Conduct A/B testing, holdouts, and shadow evaluations.

• Facilitate usability assessments and behavior reviews, customer beta testing, and previews.

• Set metrics linked to commercial outcomes and monitor adoption and success rates.

• Create dashboards and analytical tools to enhance visibility of adoption and outcomes.

• Review evaluations, experiments, analyses, and agent designs from colleagues; provide mentorship and constructive feedback.

• May oversee a dedicated intern.

• Collaborate with product management, design, engineering, and scrum team members.

⛳️ Requirements

• Proficiency in statistics and machine learning as applied to production behavior.

• Capability to design and analyze A/B tests, holdouts, and shadow runs.

• Skills to create offline and online LLM evaluation systems.

• Experience in agentic UX and behavior design, including context architecture, decision pathways, and communication flows.

• Ability to work closely with customers through pilot programs, usage analysis, beta testing, and previews.

• Competence in opening pull requests, delivering production code, creating prototypes, data pipelines, instrumentation, and reusable evaluation frameworks.

• Fluency in platform architecture, retrieval, grounding, graph logic, and AI behavior.

• Proficiency in architecting Scout graphs and complex AI interactions.

• Awareness of competitive and market trends across various verticals.

• In-depth product knowledge and understanding of industry-specific workflows.

• Ability to present to senior stakeholders and simplify complex technical and quantitative concepts.

• Skill in demonstrating the product and cross-product functionalities.

• Experience or capability to utilize AI-assisted development tools like Claude Code, Cursor, and Scout.

• Ability to navigate an existing codebase and engage in technical discussions with engineering teams.

• No specific educational qualifications or minimum years of experience required.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional development and career advancement.

• Flexible working hours and remote work options.

• Comprehensive health and wellness benefits.

• Collaborative and innovative work environment.