Principal Data Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• You are responsible for our data warehouse and the reporting infrastructure built on it, establishing standards for how data is structured, developed, and made accessible.

• You create SQL and dbt models, optimize transformations, and develop the tables and views that downstream teams depend on.

• You take the initiative to collaborate with various teams across the organization to comprehend how data is generated and utilized, pinpoint gaps, and propose solutions.

• You collaborate with our DevX and architecture teams at the intersection of product engineering services and Snowflake.

• You develop models, tests, and processes that prepare for incorrect data and upstream modifications, ensuring our pipelines are easy to manage.

• You monitor the systems you manage, establish meaningful SLOs and data quality checks, and participate in our rotating on-call schedule.

• You oversee and enhance our Python jobs operating on Glue, Lambda, and Step Functions.

• You work alongside junior engineers on practical tasks, elevate the standards for PR and architecture reviews, and establish the patterns and standards the team adheres to.

⛳️ Requirements

• 10+ years of experience in Data Engineering, Analytics Engineering, or related disciplines, functioning at a Principal level or equivalent.

• Profound expertise in relational database architecture and data modeling.

• Advanced knowledge of Snowflake and SQL, with experience managing a large-scale warehouse.

• Strong background in analytics engineering, preferably with dbt.

• Hands-on proficiency in Python, with experience in developing data jobs on AWS Glue, Lambda, and Step Functions, as well as managing that infrastructure using AWS CDK.

• Experience in integrating with third-party APIs in both directions, including handling rate limits, retries, authentication, and idempotency.

• Proven record of constructing observable, reliable data systems.

• Demonstrated technical leadership and mentorship capabilities, coupled with strong communication skills, systems thinking, and a history of engaging stakeholders across the organization to achieve cross-functional results.

🏝️ Benefits

• Competitive salary commensurate with experience, along with comprehensive medical, dental, and vision benefits.

• Equity in a rapidly growing early-stage startup.

• Generous and flexible paid time off policy.

• 401(k) plan with Financial Guidance provided by Morgan Stanley.