Senior Enterprise Data Engineer

This is a fully remote position, open to applicants in New York.

📋 Description

• Design, implement, and sustain dbt Core models within the medallion architecture.

• Incorporate MDM workflows and reference data into transformations at the medallion layer.

• Utilize mastered entities, harmonized identifiers, survivorship rules, and standardized reference values in Gold-layer models.

• Construct data models that facilitate enterprise analytics, reporting, and downstream applications.

• Adhere to naming conventions, documentation standards, testing protocols, and lineage tracking.

• Enhance SQL and dbt Core transformation logic for improved performance.

• Create, develop, and oversee data ingestion, transformation, and delivery pipelines.

• Establish job orchestration, monitoring, alerting, automated testing, and error handling processes.

• Manage version control and assist in CI/CD workflows.

• Diagnose data quality and freshness problems across Microsoft Fabric, dbt Core, and Snowflake.

• Perform root cause analysis and promote improvements in pipeline efficiency.

• Collaborate with teams in Data Management & BI and Strategy & Research.

• Facilitate data governance and quality through thorough metadata and transformation documentation.

• Recognize opportunities for workflow automation and the reduction of technical debt.

• Engage in code reviews, knowledge-sharing sessions, and team initiatives.

• Assess emerging tools and technologies in data engineering.

⛳️ Requirements

• Expert-level knowledge of dbt Core, including advanced model design, macro development, custom tests, documentation, performance optimization, and automated deployment integration.

• Advanced skills in Microsoft Fabric and/or Azure Data Factory.

• Extensive understanding of data warehousing, dimensional modeling, medallion architecture, and ELT transformation patterns.

• Strong proficiency in SQL.

• Experience with Python is preferred.

• Familiarity with Git/GitHub workflows and DevOps CI/CD practices.

• Experience utilizing cloud-native or SaaS-based data engineering tools.

• Proficiency in Snowflake is strongly preferred, including warehouse configuration, performance tuning, query optimization, cost management, and role-based access controls.

• Familiarity with Snowflake-native dbt Projects is highly preferred.

• Proficient in English.

• High School Diploma, GED, or equivalent experience is required.

• Over 5 years of practical experience in building, maintaining, and optimizing dbt Core transformation pipelines within production medallion architectures.

• More than 5 years of experience in designing, implementing, and supporting production data pipelines utilizing Microsoft Fabric or Azure Data Factory.

• Proven experience with dimensional and enterprise data modeling methodologies.

• At least 3 years of experience in designing and maintaining data warehouse models and transformation workflows.

• Minimum of 3 years of experience in contemporary cloud data warehouse environments.

• Availability for occasional off-hours support.

• Willingness to travel up to 5% of the time.

• Capable of working in a distributed, cross-functional setting.

🏝️ Benefits

• Affordable health insurance options, including medical, employer-paid dental, and optional vision coverage.

• Flexible time off policies including vacation, paid personal days, sick leave, bereavement leave, paid parental leave, and 10 paid company holidays.

• 401(k) plan with a dollar-for-dollar employer match up to 4%.

• Additional employer contribution of 4% towards retirement.

• Opportunities for professional development such as classes, on-the-job training, coaching, and mentorship.

• Possibilities for internal mobility.

• Opportunities to engage in field support.