Senior Principal Data Scientist, AEC

This is a fully remote position, open to applicants in United States, +3 more states.

📋 Description

• Design and execute predictive models to assess and foresee user behavior, intent, and outcomes within multi-agent workflows.

• Define and establish standards for data instrumentation, telemetry, and observability for agent-based systems and user interactions.

• Create frameworks and prototypes to analyze and enhance non-deterministic user experiences influenced by AI agents.

• Collaborate with product and engineering teams to integrate predictive intelligence into agent orchestration and decision-making systems.

• Develop analytical models and reporting frameworks to support business intelligence, forecasting, and performance insights.

• Guide experimentation strategies, including A/B testing, causal inference, and evaluation methodologies for agent performance.

• Provide technical leadership and recommendations regarding data architecture, model selection, and system scalability.

• Transform ambiguous, early-stage product inquiries into structured analytical programs with defined hypotheses, methodologies, and business impacts.

• Contribute to the foundational experiences for Autodesk’s agentic product platform and define and predict user and product success.

• Partner with product, engineering, and platform teams to create measurement and intelligence tools along with the necessary infrastructure.

⛳️ Requirements

• 10+ years of experience in data science or applied machine learning, with a substantial focus on product analytics or user behavior modeling.

• Capability to conduct applied research and translate emerging AI advancements into practical product and measurement innovations.

• Familiarity with large language models (LLMs), agentic systems, multi-channel platforms (MCP), tool-use frameworks, and retrieval-augmented generation (RAG) architectures.

• Understanding of AI evaluation methodologies, including benchmark datasets, offline and online assessments, LLM-as-a-Judge, human-in-the-loop evaluations, and quality measurement for non-deterministic outputs.

• Extensive experience with predictive modeling, including classification, survival analysis, sequence models, or lifetime value/propensity frameworks.

• Proficiency in designing instrumentation and event schemas for complex, stateful systems.

• Ability to establish metrics and measurement frameworks for new product domains.

• Experience working on or near AI/ML-powered products, particularly those with nondeterministic outputs.

• Skill in translating modeling efforts into product and business terminology at the executive level.

🏝️ Benefits

• Competitive compensation package.

• Annual cash bonuses may be included.

• Stock grants may be included.

• Comprehensive benefits package.

• Health and financial benefits.

• Time away.

• Everyday wellness benefits.

• In-person onboarding and/or in-person ID verification may be required.