Lead Data Engineer – Healthcare Interoperability

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and execute scalable, secure Azure data architectures supporting business intelligence, analytics, and operational systems.

• Develop and sustain data pipelines utilizing Azure Data Factory, Azure Synapse, and related services.

• Participate in designing databases across Azure SQL Database, SQL Managed Instance, PostgreSQL, and CosmosDB.

• Enhance storage strategies across Azure Blob Storage, Data Lake, and structured databases.

• Craft data models and structures for analytics and reporting purposes.

• Build and maintain stored procedures, functions, triggers, and views.

• Implement DevOps processes for databases, including schema versioning, deployment automation, and rollback procedures.

• Conduct database performance tuning, indexing, and query optimization.

• Guarantee data integrity, security, and compliance with HIPAA/HITRUST for PHI data.

• Oversee database lifecycles across development, pre-production, and production environments using RedGate Flyway.

• Design and execute ETL/ELT processes that integrate multiple data sources.

• Develop event-driven processing solutions utilizing Azure Service Bus and Event Grid.

• Integrate external REST APIs and create internal Python APIs using FastAPI/Flask on Azure Container Apps or Functions.

• Formulate data transformation logic and orchestration workflows.

• Ensure data quality, consistency, and lineage throughout the data platform.

• Integrate Azure AI services and machine learning endpoints as required.

• Review Power BI semantic models, reports, and dashboards.

• Convert business requirements into technical solutions in collaboration with stakeholders.

• Offer technical guidance and mentorship to junior developers and engineers.

• Contribute to data engineering standards, best practices, and patterns.

• Engage in architecture reviews and technical decision-making processes.

• Collaborate with DevOps and Infrastructure teams to enhance platform performance.

• Promote continuous improvement in data quality, performance, and reliability.

• Maintain technical documentation, including data dictionaries, architecture diagrams, process flows, data lineage, transformation logic, and business rules.

• Ensure the maintenance of audit trails and compliance documentation.

• Troubleshoot complex data-related challenges and provide escalation support for production issues.

• Participate in on-call rotations as necessary.

• Develop and manage EHR integrations utilizing FHIR and C-CDA.

• Support HL7 v2/MDM/ADT message flows, including parsing and acknowledgment handling.

• Define OpenAPI specifications and API versioning, and conduct contract testing.

• Lead document templating and server-side HTML-to-PDF rendering while ensuring accessibility and compliance.

⛳️ Requirements

• Bachelor’s degree in computer science, Information Systems, Data Engineering, or a related field, or equivalent work experience.

• Over 8 years of experience in data engineering, database development, or similar roles.

• Expert-level proficiency in T-SQL and Microsoft SQL Server.

• Expert-level proficiency in Python.

• Experience in building REST APIs and background workers in Python (FastAPI/Flask).

• Understanding of event-driven architectures and asynchronous processing patterns.

• Strong experience with Azure data services, including Azure SQL, Data Factory, Synapse, and Blob Storage.

• Hands-on experience in building and maintaining data pipelines and ETL/ELT processes.

• Knowledge of Power BI development, including DAX, data modeling, and performance optimization.

• Solid understanding of database design principles, normalization, and data modeling.

• Experience with Git and CI/CD practices.

• Strong analytical and problem-solving skills with a keen attention to detail.

• Excellent written and verbal communication abilities.

• Capability to work independently as well as collaboratively.

• Microsoft certification (Azure Data Engineer Associate, Azure Database Administrator, Power BI Data Analyst).

• Familiarity with Infrastructure as Code, including Terraform, Bicep, and ARM templates.

• Knowledge of Azure Container Apps, Functions, and Logic Apps.

• Experience with PostgreSQL and CosmosDB.

• Understanding of HIPAA/HITRUST compliance requirements for healthcare data.

• Experience using PowerShell for automation and scripting.

• Experience with Azure DevOps or similar CI/CD platforms.

• Experience with data governance, cataloging, and metadata management.

• Background in healthcare technology or regulated industries.

• Experience with OpenAPI/Swagger specification design and contract testing.

• Proficiency in advanced AI development tools, such as Claude Code and GitHub Copilot.

• Knowledge of Azure API Management and private networking patterns.

• Practical experience with FHIR, including resources, search parameters, OAuth2, and SMART on FHIR.

• Experience integrating with Epic, Cerner, Athena, or other EHR/EMR systems.

• Experience with HL7 v2, including MLLP, MDM, and ADT message handling.

• Willingness to travel up to 15%.

🏝️ Benefits

• Flexible remote or virtual work arrangement.

• Travel opportunities up to 15%.

• Opportunities for technical leadership and mentorship.

• Microsoft certification opportunities/requirements involving Azure Data Engineer Associate, Azure Database Administrator, or Power BI Data Analyst.