Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, construct, and manage data pipelines utilizing Airflow, dbt, and Snowflake.

• Implement the canonical healthcare data model for Lyric in a production environment.

• Develop automated validation and quality assurance measures throughout the pipeline stages.

• Equip pipelines with monitoring for data freshness, lineage tracking, and failure notifications.

• Contribute to self-service governed data capabilities for teams that consume data.

• Collaborate with invoicing, analytics, and reporting teams to convert requirements into dependable data.

• Migrate and streamline existing workloads onto the unified framework without disrupting users.

• Engage in on-call rotations for pipeline and data quality incidents as well as incident reviews.

• Uphold high engineering standards through version control, testing, code reviews, CI/CD, and up-to-date documentation.

• Guide and mentor engineers, sharing knowledge while enhancing technical competencies.

⛳️ Requirements

• Candidates must already possess legal authorization to work in the U.S.; visa sponsorship, assumption of sponsorship, and other immigration assistance are not provided.

• Bachelor’s degree in Software Engineering, Computer Science, or a related discipline.

• Over 5 years of experience in data engineering, with a focus on building and managing production data pipelines.

• Proficient in Snowflake, including streams and tasks, warehouse sizing and performance optimization, SQL enhancement, RBAC, clustering, and micro-partitioning.

• Hands-on experience with dbt and Airflow, focusing on maintainable models and DAGs.

• Strong programming skills in Python with advanced proficiency in SQL.

• Competent in data modeling and experienced in designing schemas for diverse consumers.

• Familiarity with integrating testing and data quality validation within pipelines.

• Experience with version control, code reviews, automated testing, and CI/CD processes.

• Ability to work directly with non-engineering data consumers and articulate constraints and trade-offs effectively.

• Preferred qualifications include experience with multi-tenant data platforms, temporal data modeling, healthcare claims or payments, handling of PHI/PII and auditability, Datadog or similar observability tools, and internal tooling or platforms.

🏝️ Benefits

• Competitive salary and comprehensive benefits package.

• Opportunities for professional development and continuous learning.

• Flexible work environment with options for remote work.

• Collaborative and inclusive workplace culture.