
Data Engineering Manager
Posted 6 hours ago

Posted 6 hours ago
This is a fully remote position, open to applicants in Pennsylvania, +1 more location.
• Lead and grow a high-performing data engineering team through hands-on technical guidance, mentorship, and the implementation of best practices.
• Design, build, and enhance a centralized, cloud-native data platform that supports a variety of healthcare datasets, including medical and Rx claims, EHR, CCLF, and BCDA data sources.
• Create, implement, and manage scalable data pipelines for ingestion, transformation, and normalization to support analytics, machine learning, and GenAI applications.
• Establish batch processing, streaming services, and FHIR-based APIs for data ingestion into the data lake.
• Enhance data platforms and pipelines for optimal performance, reliability, scalability, and cost-effectiveness.
• Direct data governance standards, access controls, and encryption measures to ensure compliance with HIPAA and SOC 2 certification requirements.
• Develop and sustain documentation that details data platform architecture, ETL/ELT processes, data lineage, and metadata.
• Collaborate with data science, QA, software engineering, product, and business stakeholders to provide reliable, timely, high-quality data assets.
• Work alongside DevOps for automated, scalable deployment utilizing CI/CD and infrastructure-as-code methodologies.
• Keep abreast of developments in data engineering, healthcare data management, and advanced analytics to enhance the platform and team.
• Report directly to the CTO.
• Over 8 years of experience in data engineering, with a proven track record in coaching and developing technical talent, and leading the design, delivery, and operation of cloud-based data platforms in production settings.
• Deep expertise in Python, SQL, and contemporary ETL/ELT frameworks for constructing reliable, production-level data workflows.
• Practical experience with Databricks, Snowflake, and AWS services (such as S3, Glue, Lambda, EMR), in addition to modern data platform technologies and transformation tools like dbt or SQLMesh.
• Strong capability to design scalable, modular codebases that encourage maintainability, reusability, testing, and collaboration across teams.
• Experience in implementing and utilizing data lineage to understand dependencies, evaluate upstream and downstream impacts, and support governance and change management.
• Solid grasp of data governance, data quality, and data security principles, including their application within regulated environments.
• Proficient in data modeling, database design, and data warehousing concepts for both analytical and operational applications.
• Ability to effectively collaborate with DevOps to define and align on deployment standards, environment management, and operational best practices for data platforms and pipelines.
• Familiarity with healthcare data interoperability standards and APIs.
• Health, dental, vision, and voluntary benefits.
• Competitive salary, incentive compensation, and equity shares.
• 401(k) retirement savings plan.
• Flexible PTO and 10 paid holidays.
• Flexible working hours.
• Paid leave programs.
• Marketplace offering discounted retail and entertainment options.
ClickHouse
Salsify
Paymentology
Agilent Technologies
Get handpicked remote jobs straight to your inbox weekly.