Senior Principal Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop a cohesive MLOps and forecasting platform utilizing Databricks.

• Create and manage automated pipelines for simulating campaign performance and forecasting future outcomes.

• Track and forecast budget usage in real-time to avoid over-delivery or under-delivery situations.

• Establish an Incrementality Testing framework to measure the causal effects of advertising exposure.

• Set up CI/CD and deployment standards for scalable, refreshed, and easily debuggable models.

• Define standards for clean data and telemetry-first approaches.

• Analyze extensive datasets to uncover trends and insights that enhance model performance and advertising results.

• Collaborate with Applied Scientists on GenAI patterns and automated architectural solutions.

• Convert business objectives into technical roadmaps alongside product and business stakeholders.

• Guide senior and staff engineers while promoting operational excellence and swift development speed.

⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related discipline; PhD is preferred.

• Over 10 years of experience in data engineering, focusing significantly on production MLOps pipelines.

• Proficient in the Databricks Data Intelligence Platform, including Unity Catalog and MLflow.

• Strong command of Python, SQL, and PySpark.

• Extensive knowledge of data modeling and semantic-layer design for large-scale analytics.

• Proven experience leading large-scale architectural migrations and managing technical debt effectively.

• Solid understanding of time-series forecasting, statistical modeling, or causal inference techniques, such as Lift Analysis.

• Excellent communication skills with the ability to influence executive stakeholders.

• Expertise in integrating complex predictive models into high-traffic Marketplace funnels.

• Experience with real-time systems and large-scale data-processing technologies like Kafka or Kinesis.

• Familiarity with Learning to Rank models and the associated challenges of productionization.

• Demonstrated capacity to implement AI-driven assistants for product development, alert triage, and workload migration.

• Familiarity with or readiness to work in macOS and Google Workspace; support is available for both macOS and Windows.

🏝️ Benefits

• Flexible paid time off alongside company holidays.

• Medical, dental, and vision insurance starts on your first day.

• 401(k) retirement plan with company matching contributions.

• Student loan debt repayment option available through the 401(k) plan.

• Employee Stock Purchase Plan offered.

• Educational assistance for ongoing education and training.

• Lifestyle Spending Account dedicated to physical, emotional, and financial wellness.

• Complimentary subscriptions to the Calm app.

• Support provided for both macOS and Windows platforms.