Lead Data Engineer – Healthcare Interoperability

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop scalable and secure Azure data architectures for business intelligence, analytics, and operational systems.

• Construct and sustain data pipelines utilizing Azure Data Factory, Azure Synapse, and related services.

• Contribute to the design of databases across Azure SQL Database, SQL Managed Instance, PostgreSQL, and CosmosDB.

• Optimize storage solutions across Azure Blob Storage, Data Lake, and structured databases.

• Create data models and structures for analytics and reporting purposes.

• Develop stored procedures, functions, triggers, and views.

• Implement database DevOps methodologies, including schema versioning, deployment automation, and rollback strategies.

• Conduct performance tuning, indexing, and query optimization for databases.

• Ensure data integrity, security, and compliance with HIPAA/HITRUST for PHI.

• Manage database lifecycles throughout development, pre-production, and production using RedGate Flyway.

• Design ETL/ELT processes and event-driven processing solutions utilizing Azure Service Bus and Event Grid.

• Integrate external REST APIs and develop internal Python APIs using FastAPI/Flask on Azure Container Apps or Functions.

• Create transformation logic and orchestration workflows.

• Ensure data quality, consistency, and lineage.

• Integrate Azure AI services and machine learning endpoints as necessary.

• Review Power BI semantic models, reports, and dashboards.

• Translate stakeholder requirements into actionable technical solutions.

• Provide technical mentorship and guidance to junior developers and engineers.

• Engage in architecture reviews and contribute to technical decision-making.

• Collaborate with DevOps and Infrastructure teams to enhance platform capabilities.

• Generate technical documentation, data dictionaries, architecture diagrams, process flows, lineage documentation, and audit trails.

• Troubleshoot complex data issues and offer escalation support for production incidents.

• Participate in on-call rotation as necessary.

• Build EHR integrations utilizing FHIR and C-CDA, and support HL7 v2 message flows.

• Define OpenAPI specifications and manage API versioning, including writing contract tests.

• Lead document templating and server-side rendering of HTML-to-PDF pipelines.

⛳️ Requirements

• Bachelor’s degree in computer science, Information Systems, Data Engineering, or a related field, or equivalent professional experience.

• Over 8 years of experience in data engineering, database development, or similar roles.

• Expert-level knowledge in T-SQL and Microsoft SQL Server.

• Proficient in Python programming.

• Experience in creating REST APIs and background workers using Python (FastAPI/Flask).

• Understanding of event-driven architectures and asynchronous processing methodologies.

• Strong experience with Azure data services (including Azure SQL, Data Factory, Synapse, Blob Storage, etc.).

• Practical experience in building and maintaining data pipelines and ETL/ELT processes.

• Familiarity with Power BI development, including DAX, data modeling, and optimization techniques.

• Comprehensive understanding of database design principles, normalization, and data modeling.

• Experience with Git and CI/CD methodologies.

• Relevant Microsoft certifications (such as Azure Data Engineer Associate, Azure Database Administrator, Power BI Data Analyst).

• Knowledge of Infrastructure as Code (including Terraform, Bicep, ARM templates).

• Familiarity with Azure services like Container Apps, Functions, and Logic Apps.

• Experience with PostgreSQL and CosmosDB.

• Understanding of HIPAA/HITRUST compliance standards.

• Experience using PowerShell for automation and scripting tasks.

• Familiarity with Azure DevOps or comparable CI/CD platforms.

• Experience in data governance, cataloging, and metadata management.

• Background in healthcare technology or regulated industries.

• Experience with OpenAPI/Swagger specification design and contract testing.

• Proficiency in advanced AI development tools, such as Claude Code and GitHub Copilot.

• Knowledge of Azure API Management and private networking strategies.

• Ability to travel up to 15% as needed.

• Preferred: Practical experience with FHIR, C-CDA, Epic, Cerner, Athena, and HL7 v2/MLLP/MDM/ADT.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Comprehensive health, dental, and vision insurance.

• Generous paid time off and holiday leave policy.

• Opportunities for professional development and continuing education.

• Flexible work environment and options for remote work.