Lead Data Engineer, Healthcare Interoperability

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead Data Engineer - Healthcare Interoperability

• We are searching for a seasoned Lead Data Engineer to become part of our healthcare technology team, primarily focusing on healthcare interoperability.

• This position will play a crucial role in the design, construction, and maintenance of our Azure-based data infrastructure, encompassing databases, data pipelines, analytics platforms, and business intelligence solutions — particularly aimed at integrating with Electronic Health Record (EHR) systems and healthcare data exchange standards (FHIR, C-CDA, HL7).

• The ideal applicant will possess extensive knowledge of the Microsoft data stack, demonstrate strong architectural thinking, and have experience with healthcare data compliance regulations.

• This senior-level role will also offer technical leadership and mentorship to the wider engineering team, reporting directly to the Director of Data Engineering.

• Design and implement scalable, secure data architectures on Azure to support business intelligence, analytics, and operational systems.

• Build and maintain data pipelines utilizing Azure Data Factory, Azure Synapse, and relevant services.

• Contribute to database designs across various platforms (Azure SQL Database, SQL Managed Instance, PostgreSQL, CosmosDB).

• Optimize data storage strategies across Azure Blob Storage, Data Lake, and structured databases.

• Design data models and structures that facilitate efficient analytics and reporting.

• Design, develop, and maintain intricate stored procedures, functions, triggers, and views.

• Implement database DevOps processes, including schema versioning, deployment automation, and rollback procedures.

• Conduct database performance tuning, indexing strategies, and query optimization.

• Ensure data integrity, security, and compliance with HIPAA/HITRUST requirements for PHI data.

• Manage the database lifecycle across development, pre-production, and production environments utilizing RedGate Flyway.

• Design and implement ETL/ELT processes to integrate data from various sources.

• Construct event-driven data processing solutions, including message producers, consumers, and workers using Azure Service Bus, Event Grid, and related messaging services.

• Integrate external REST APIs for data ingestion and create internal data APIs using Python (FastAPI/Flask) on Azure Container Apps or Functions.

• Develop data transformation logic and orchestration workflows.

• Ensure data quality, consistency, and lineage across the data platform.

• Integrate with Azure AI services and machine learning endpoints as required.

• Review designs of Power BI solutions, including semantic models, reports, and dashboards.

• Work collaboratively with stakeholders to convert business requirements into technical solutions.

• Optimize data structures for enhanced reporting and analytics performance.

• Provide technical direction and mentorship to junior developers and engineers.

• Contribute to data engineering best practices, standards, and methodologies.

• Engage in architecture reviews and technical decision-making.

• Collaborate with DevOps and Infrastructure teams on platform enhancements.

• Promote continuous improvements in data quality, performance, and reliability.

• Create and maintain detailed technical documentation, including data dictionaries, architecture diagrams, and process flows.

• Document data lineage, transformation logic, and business rules.

• Ensure all data handling practices comply with HIPAA/HITRUST regulations.

• Maintain audit trails and documentation for compliance purposes.

• Troubleshoot and resolve complex data-related issues across the platform.

• Provide escalation support for production incidents.

• Collaborate with cross-functional teams to support business operations.

• Participate in on-call rotation as necessary.

⛳️ Requirements

• Bachelor’s degree in computer science, Information Systems, Data Engineering, or a related field, or equivalent work experience.

• Over 8 years of experience in data engineering, database development, or related roles.

• Expert-level proficiency in T-SQL and Microsoft SQL Server.

• Expert-level proficiency in Python.

• Experience in building REST APIs and background workers using Python (FastAPI/Flask).

• Understanding of event-driven architectures and asynchronous processing patterns.

• Strong background in Azure data services (Azure SQL, Data Factory, Synapse, Blob Storage, etc.).

• Practical experience in building and maintaining data pipelines and ETL/ELT processes.

• Knowledge of Power BI development skills, including DAX, data modeling, and performance optimization.

• Solid grasp of database design principles, normalization, and data modeling.

• Familiarity with version control systems (Git) and CI/CD practices.

• Strong analytical and problem-solving skills with keen attention to detail.

• Excellent written and verbal communication abilities.

• Capacity to work both independently and collaboratively within a team environment.

• Microsoft certification (Azure Data Engineer Associate, Azure Database Administrator, Power BI Data Analyst).

• Knowledge of Infrastructure as Code (Terraform, Bicep, ARM templates).

• Familiarity with additional Azure services (Container Apps, Functions, Logic Apps).

• Experience with other database platforms (PostgreSQL, CosmosDB).

• Understanding of HIPAA/HITRUST compliance requirements for healthcare data.

• Proficient in using PowerShell for automation and scripting.

• Experience with Azure DevOps or similar platforms for CI/CD.

• Familiarity with data governance, cataloging, and metadata management.

• Background in healthcare technology or regulated industries.

• Experience with OpenAPI/Swagger specification design and contract testing.

• Proficient in advanced usage of AI development tools (e.g., Claude Code, GitHub Copilot).

• Knowledge of Azure API Management and private networking patterns.

• Willingness to travel up to 15%.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Comprehensive health, dental, and vision insurance.

• 401(k) plan with company match.

• Flexible working hours and remote work opportunities.

• Professional development and training programs.

• Generous paid time off and holiday schedule.