Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and enhance the Claims Data Warehouse utilizing Snowflake.

• Establish continuous and batch data ingestion into Snowflake through Snowpipe, COPY INTO, external stages, and Azure Blob Storage/ADLS Gen2.

• Execute incremental and near-real-time processing using Snowflake Streams, Tasks, and Dynamic Tables, incorporating CDC, schema drift management, and error recovery.

• Apply medallion architecture from initial claim ingestion to standardized, deduplicated claim data, culminating in analytics-ready marts.

• Optimize performance and cost in Snowflake through warehouse sizing, Query Profile, clustering keys, search optimization, materialized views, and resource monitors.

• Uphold Snowflake security and governance practices, including RBAC, dynamic data masking, row access policies, object tagging, and secure data sharing.

• Utilize Snowflake Time Travel, Fail-safe, zero-copy cloning, and replication for backup, recovery, testing, and BCDR purposes.

• Develop SQL, Snowpark, and stored procedures for ETL/ELT processes involving large volumes of claims data.

• Model claim header and line structures while managing the comprehensive claim lifecycle.

• Implement and maintain healthcare code sets and reference data.

• Create claims-based data products for utilization management, case management, cost and trend analysis, PMPM reporting, provider and network analytics, quality measures, risk adjustment, and financial reporting.

• Conduct claims data quality and reconciliation assessments, including financial balancing, duplicate detection, eligibility matching, and completeness/timeliness validation.

• Collaborate with stakeholders in claims, medical management, actuarial, finance, and analytics.

• Build, schedule, and oversee ADF ETL/ELT pipelines with parameterization, alerting, and retry logic.

• Leverage Azure services including ADLS Gen2/Blob Storage, Key Vault, Microsoft Entra ID, Azure Monitor, and Azure SQL/SQL Server.

• Maintain and transition SSIS packages, modernizing them into ADF and Snowflake patterns.

• Contribute to CI/CD, Git, Azure DevOps, and infrastructure-as-code methodologies.

• Utilize AI tools such as Snowflake Cortex, GitHub Copilot, Microsoft Copilot in Fabric, and LLM-based assistants.

• Enhance SQL queries and database structures across both Snowflake and SQL Server.

• Develop and sustain data pipelines between source systems and the EDW, integrating data services with applications and business systems.

• Monitor platform health, performance, latency, data freshness, and storage; manage security, backup, and recovery operations.

• Stay updated on Snowflake, cloud data engineering, healthcare data standards, and best practices for SQL optimization.

⛳️ Requirements

• A Bachelor's degree in Computer Science, Information Technology, or a related discipline.

• A minimum of 10 years of experience in a healthcare setting, emphasizing SQL and Enterprise Data Warehousing.

• Practical experience with Snowflake, including Snowpipe, Streams and Tasks, Dynamic Tables, COPY INTO, RBAC, masking and row access policies, warehouse sizing and performance optimization, and secure data sharing.

• Background in implementing medallion architecture (Bronze, Silver, and Gold layers) in Snowflake or another cloud data warehouse/lakehouse environment.

• Significant hands-on experience with medical claims data, including claim header/line structures, adjustments and reversals, and eligibility/enrollment data.

• Familiarity with X12 EDI healthcare transactions (837, 835, 834, 270/271, 276/277) and claim forms (CMS-1500, UB-04).

• Proficient knowledge of healthcare code sets and reference data, such as ICD-10, CPT/HCPCS, revenue codes, DRG, NDC, and place of service.

• Experience in building claims-based analytics and reporting, including utilization, cost and trend analysis, PMPM, risk adjustment, and quality measures (e.g., HEDIS).

• Practical experience with Azure Data Factory (ADF) and Azure data services like ADLS Gen2/Blob Storage, Key Vault, and Azure DevOps.

• Experience with SQL Server Integration Services (SSIS) and SQL Server (preferred), particularly in maintaining or migrating legacy packages.

• Strong understanding of data modeling and database design principles, including dimensional modeling and managing slowly changing dimensions and claim versioning.

• Knowledge of data security, privacy, backup, and recovery procedures (i.e., BCDR), including HIPAA compliance and handling of PHI/PII.

• Familiarity with Git-based version control and CI/CD practices (Azure DevOps or similar).

• Understanding of Agile methodologies with experience in Agile environments.

• Excellent communication skills for collaboration across business functions, including clinical, claims, and finance teams.

• Ability to manage multiple projects, issues, and deliverables in a dynamic environment.

• Capable of multitasking and prioritizing tasks to meet deadlines.

• Strong listening, critical thinking, written, and verbal communication skills.

• Works effectively in a team-oriented environment.

• Experience in a professional setting with clinical managed care concepts, practices, and procedures is preferred.

🏝️ Benefits

• Paid Time Off

• Paid Parental Leave

• Medical, dental, and vision benefits

• 401K with company match

• Short- and Long-Term Disability

• Group Life Insurance

• Tuition Reimbursement

• Pet Insurance

• Opportunities for professional development

• Business Casual work environment