Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and deploy production pipelines on Databricks, utilizing a medallion architecture based on Data Vault 2.0 modeling principles.

• Develop and strengthen the curated and presentation layers—enhancing donor lifetime value, retention, lapse risk, and campaign ROI.

• Resolve identity across products to generate values on a single reliable record.

• Progress towards near-real-time data and collaborate with architects on Change Data Capture.

• Enhance existing tracing and AI lifecycle tools within ETL processes.

• Collaborate with AI and product engineers to ensure data is appropriately structured for applications.

• Utilize AI tools in everyday development activities.

• Elevate engineering standards by addressing testing, idempotency, documentation, and security aspects.

⛳️ Requirements

• Over 5 years of experience in building production data pipelines on a modern lakehouse or warehouse, with a strong preference for Databricks with Unity Catalog.

• Proficient in matching and merging records across systems—entity resolution, deduplication/merging, or master-data "golden record" tasks.

• Strong skills in SQL and Python (or Scala), with familiarity in PySpark being advantageous.

• Solid understanding of dimensional and/or Data Vault 2.0 modeling patterns.

• Practical experience in operating pipelines in production environments—monitoring, alerting, and effective error handling.

• Familiarity with streaming and Change Data Capture (CDC).

🏝️ Benefits

• Access to comprehensive health, vision, and dental insurance options, along with HealthiestYou, a healthcare service providing convenient, confidential access to quality doctors 24/7, anytime, anywhere.

• A competitive PTO package that includes 20 PTO days, 3 flex days, 4 optional volunteer days, 12 paid holidays, and paid parental leave. More is better!

• A 401k match to assist in investing in your future.

• All the resources you need to thrive, delivered right to your door. You've got this. We’ve got your back.