Product Manager, Analytics & ML

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Take charge of the data aspect of Maestra.io’s ecommerce marketing platform

• Create metrics and reports for merchants that cover attribution, loyalty economics, recommendation performance, popup funnels, and segment comparisons

• Define metrics for the semantic layer, including slices, aggregates, and partitions

• Develop report prototypes using SQL and provide specifications to the engineering team

• Address methodology challenges related to cross-brand attribution, email opens, multi-currency revenue, and report inconsistencies

• Manage A/B testing methodologies across widget tests, campaign tests, and flow control groups

• Review experiments for comparable groups, participant counts, sample sizes, and statistical significance

• Establish statistically valid defaults for merchants

• Oversee the recommendation framework, including quality assessments, degradation tracking, debugging, and improvement planning

• Determine the role of embeddings and LLM re-ranking in enhancing or replacing traditional collaborative filtering

• Validate ML enhancements with objective assessments against a baseline

• Utilize SQL, Python, Metabase, Notion, and Slack within a multi-tenant lakehouse setup

• Collaborate across engineering, customer success, other product managers, merchants, and the founder-CEO

• Report directly to the founder-CEO/CPO

• Engage in asynchronous Q&A, complete a test task, and participate in final hiring discussions

⛳️ Requirements

• Proficient in SQL, including window functions over large partitioned tables and SQL performance tuning

• Understanding of A/B testing mathematics and statistical fundamentals, encompassing power, MDE, selection bias, survivorship bias, post-treatment variables, sample sizes, and significance

• Ability to make judgments on embeddings, vector similarity, LLM re-ranking, and assessments against baselines

• Experience working directly with non-technical end users and transforming their needs into delivered products

• Background in B2B products, consulting, solutions engineering, or senior customer-facing roles

• Strong written communication skills and the capability to articulate methodology arguments in writing

• Proficiency in Russian as the working language within the team

• English proficiency at B2+; fluency is preferred

• Reside in the EU

• Daily availability overlapping with US Eastern time

• Significant advantage: experience in the ecommerce or martech sector

• Significant advantage: previous responsibility for a metric or semantic layer

• Significant advantage: hands-on experience with recommender or ranking systems

🏝️ Benefits

• High likelihood of skill development

• Career and compensation growth aligned with the company's expansion

• Fully remote work environment

• Asynchronous-first approach to work and hiring

• Daily availability overlapping with US Eastern time

• Opportunity to engage with real merchants and deliver work within weeks