Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of one or more data engineering workstreams, overseeing everything from technical design to production deployment and handoff.

• Create and implement scalable data models and lakehouse architectures, incorporating medallion patterns when suitable.

• Enhance performance and manage costs across Databricks and the associated cloud, treating compute spending as your responsibility.

• Manage workflows utilizing Databricks Workflows, Delta Live Tables, or similar tools.

• Establish governance, security, observability, and lineage using Unity Catalog, while also setting up CI/CD for data.

• Design and construct AI-ready data platforms that facilitate dependable analytics, machine learning, and autonomous applications.

• Collaborate directly with client stakeholders to collect requirements and convert them into technical solutions.

• Review code, mentor junior engineers, and uphold high engineering standards throughout your workstreams.

• Contribute reusable accelerators, frameworks, and best practices back to the practice.

⛳️ Requirements

• Over 6 years of experience in data engineering or analytics engineering.

• Advanced knowledge in building production data pipelines utilizing Apache Spark (PySpark and SQL), with a focus on performance optimization.

• Hands-on experience in a production setting with Databricks (Delta Lake, Jobs, Workflows, Unity Catalog).

• Significant experience with at least one major cloud platform (AWS, Azure, or GCP).

• Strong fundamentals in SQL and data modeling.

• Proven history of developing and maintaining production-grade data pipelines rather than just prototypes.

• Comfortable working directly with client stakeholders to translate business needs into technical solutions.

• Demonstrated capability to independently manage a data engineering workstream from design through production.

🏝️ Benefits

• Competitive base salary with performance-based bonuses

• MacBook Pro and swag kit to support your best work

• Comprehensive health, dental, and vision insurance

• Generous holidays, flexible PTO, and a remote-first work environment

• Professional development budget including Databricks and cloud certifications

• Spot bonuses for relevant certifications

• Opportunities for conference attendance and thought leadership

• A collaborative, low-ego culture with direct access to leadership

• Chance to influence a growing practice from the ground up