Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create, develop, and manage dependable, automated data pipelines for health plan data.

• Transform intricate healthcare data into standardized and analytical models.

• Transition legacy processes, pipelines, and models to a unified platform while maintaining existing logic and functionality.

• Enhance and integrate tools and workflows for utilization by other teams.

• Apply data quality and software engineering practices, which encompass validation, automated testing, code reviews, and CI/CD.

• Document engineering tasks and rigorously evaluate AI-generated outputs.

• Take ownership of pipelines from start to finish, encompassing ingestion, modeling, quality assurance, deployment, and daily operations.

• Facilitate decision-making and influences claims payment results.

• Collaborate with ML, Product, Analytics, Platform, Operations, and Customer teams.

• Manage the lifecycle of essential datasets that drive the platform.

• Assist in customer onboarding and data integration efforts.

⛳️ Requirements

• Over 5 years of experience in data engineering, including hands-on production management of developed pipelines.

• Proficient in SQL and Python.

• Strong skills in data modeling, including canonical and dimensional design, handling conflicting sources, history, and adjustments.

• Experience with production dbt and workflow orchestration tools (Airflow or equivalent).

• Expertise in Snowflake and/or Databricks.

• Familiarity with Spark SQL.

• Knowledge of data quality and CI/CD practices, which include validation, reconciliation, pull requests, automated testing, and deployment automation.

• Capability to manage broad, vaguely defined issues from ingestion to modeling, infrastructure, APIs, and operations, including incident management.

• Proficiency in onboarding new data sources from discovery to delivery.

• Proven track record of enhancing or integrating existing tools and creating solutions for other teams.

• Ability to quickly grasp complex domains and assess AI-generated code and abstractions against established truths.

• Understanding of how to utilize AI for development and automation, considering both efficiency and potential risks.

🏝️ Benefits

• Work remotely from anywhere in the US; enjoy a digital-first environment.

• Comprehensive Medical/Dental/Vision coverage for employees and their families.

• A flexible and trusting work environment.

• Unlimited flexible time off (FTO).

• Competitive salary package.

• Equity opportunities.

• 401(k) plan with employer matching.

• Meaningful equity participation.

• Excellent healthcare benefits.

• Flexible time off policies.

• Additional benefits and perks.