Staff Data Engineer

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• In the role of Staff Data Engineer, you will deliver senior onshore technical leadership for the data engineering team.

• You will take ownership of a specific segment of our centralized Databricks data platform, bearing full responsibility for decisions and outcomes.

• Act as a technical partner to the Principal Data Platform Engineer.

• Propel architectural decision-making and independent problem-solving as platform complexity increases following migration.

• Construct and sustain production data pipelines in accordance with the patterns and governance set by the Lead Data Platform Engineer, ensuring reliability and performance at a multi-terabyte scale.

• Apply architectural judgment concerning data modeling, pipeline design, and platform utilization.

• Actively engage with product and engineering stakeholders to convert requirements into effective data solutions.

⛳️ Requirements

• A minimum of 5 years of experience in data engineering, demonstrating the capability to manage problems from start to finish with minimal supervision.

• Proficiency in SQL, Python, and PySpark for production pipeline implementation and performance enhancement.

• Experience with Databricks, including Delta Lake, Workflows, and Databricks SQL; familiarity with Unity Catalog is preferred.

• Proven track record in building and maintaining ETL/ELT pipelines at scale, which includes error management, monitoring, and data quality validation.

• Strong skills in data modeling across both structured and semi-structured data sources.

• Experience with AWS (S3, IAM, VPC) and the ability to collaborate on infrastructure decisions.

• Familiarity with infrastructure-as-code, preferably with Terraform.

• Understanding of data governance practices, including Unity Catalog, data lineage, and access controls.

• A demonstrated ability to exercise independent architectural judgment rather than merely executing tickets.

• Experience in mentoring or guiding junior and mid-level data engineers.

• Excellent written and verbal communication skills, capable of documenting architectural decisions and interacting directly with both technical and business stakeholders.

• Onshore (US-based)—the role necessitates timezone overlap, minimal asynchronous communication, and direct engagement with stakeholders.

🏝️ Benefits

• A collaborative team environment that fosters opportunities for career advancement.

• Numerous chances to gain recognition, develop valuable skills, and advance your career.

• Generous vacation policy, which includes paid parental leave.

• Comprehensive health insurance plans with FSA and HSA options.

• 401(k) retirement savings plan.

• Coverage for life and disability insurance.

• Additional benefits such as a dependent care savings plan, pet insurance, will preparation services, and an employee assistance program.