Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, create, and maintain high-volume ETL/ELT data integration solutions utilizing Ab Initio and Snowflake.

• Develop and sustain Ab Initio graphs, Plans, PSETS, Continuous Flows, and batch processing frameworks.

• Construct reusable ETL components, transformations, DML files, XFRs, and PDL scripts.

• Oversee and support the Ab Initio EME / Metadata Hub, which includes managing metadata, lineage, impact analysis, and dataset mapping.

• Create and enhance Snowflake solutions, incorporating Snowpipe, Streams, Tasks, Time Travel, and Zero-Copy Cloning.

• Execute advanced SQL development, query optimization, data reconciliation, and data quality validation.

• Design and uphold data warehouse solutions employing dimensional modeling, Star/Snowflake schemas, and Data Vault concepts.

• Develop automation and operational support tools utilizing Python and Shell scripting (KSH/Bash).

• Support data integrations that are batch, real-time, file-based, and API-driven.

• Engage in CI/CD, Git-based development, code promotion, branching, and release management processes.

• Diagnose production issues and ensure the reliability, scalability, and performance of data pipelines.

• Collaborate with both technical and business teams to convert data requirements into scalable solutions.

• Work with healthcare data domains, which include claims, membership, providers, health plans, benefits, and employer/group data.

⛳️ Requirements

• Over 6 years of practical experience with Ab Initio development.

• More than 4 years of experience in Snowflake development and architecture.

• Proficient in advanced SQL skills, including complex joins, subqueries, stored procedures, dynamic SQL, and query tuning.

• Extensive experience with Ab Initio EME / Metadata Hub, version control, sandbox management, check-in/check-out, and tag promotion.

• Familiarity with data warehouse architecture, dimensional modeling, Star/Snowflake schemas, Data Vault, MDM concepts, and source-to-target mapping.

• Expertise in Python and Shell scripting (KSH/Bash).

• Strong grasp of ETL/ELT patterns, batch and real-time processing, API integrations, and large-scale data movement.

• Experience with DevOps and CI/CD practices, including Git, branching strategies, automated deployments, and release management.

• Background in working with Azure-based data environments.

• Knowledge of healthcare data, particularly concerning claims, membership, providers, health plans, benefits, and employer/group data.

• Excellent analytical, troubleshooting, and problem-solving abilities.

• Capability to work independently in a complex enterprise data environment while collaborating effectively with cross-functional teams.

• Must be eligible to work and reside in the United States as a U.S. citizen, U.S. national, lawful permanent resident, asylee, or refugee.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Retirement savings plan with employer matching.

• Generous paid time off and holiday schedule.

• Opportunities for professional development and career growth.