Associate Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee daily Snowflake data loads, file ingestion, and scheduled tasks; ensure the timely arrival, proper landing, and error-free processing of expected files.

• Manage and maintain drop-zone/upload-zone, data lake, and SFTP file transfers (e.g., Couchdrop, Azure Data Factory, service-account-based movements); address failures and rejected files.

• Promptly respond to issues related to files, loading, and data quality in a well-documented manner; escalate and collaborate with data engineering, pre-processing, and IT as necessary.

• Maintain and act upon file-level monitoring and alert systems—tracking “expected vs. received,” format/validation alerts, and conducting hold-folder sweeps.

• Act as a trained backup for core data warehouse operations to ensure critical pipelines and client deliverables are maintained during absences and peak periods.

• Acquire knowledge and document existing pipelines, jobs, schedules, and troubleshooting procedures to ensure that recurring tasks are reproducible and not reliant on a single individual or personal account.

• Assist in supporting regular client and regulatory file submissions (e.g., monthly stop-loss, claims, and accumulator files) according to a shared, documented schedule.

• Construct and maintain tables, views, and dbt models under direction; contribute to data modeling, data vault, and schema development for reporting and analytics purposes.

• Create and sustain crawlers, file validators, and file-rejection protocols; aid in automating manual file downloads and uploads into the warehouse.

• Support Snowflake administration tasks—role and grant management, adherence to MFA/security SOPs, storage account configuration, and backup/clone routines—while following established security protocols.

• Conduct quality assurance on loaded data and reconcile discrepancies across source systems prior to release; assist with data accuracy checks and audits.

• Ensure clear documentation is maintained: pipelines, data sources, schedules, SOPs, and runbooks (including the development-to-production process).

• Collaborate with data engineering, pre-processing, analytics, and IT/security to gather requirements and facilitate the transition of work into production.

⛳️ Requirements

• A degree in a quantitative or technical discipline (Computer Science, Information Systems, Data, Engineering), or equivalent experience; this position is geared towards early-career professionals.

• 1–3 years of experience with SQL and cloud data warehouse platforms, preferably Snowflake.

• Proficient SQL skills and familiarity with a cloud data warehouse (Snowflake preferred; comparable platforms will be considered).

• Comfortable working with data files and pipelines—including CSV/flat files, SFTP, encryption/PGP concepts, and troubleshooting file/load errors.

• Strong attention to detail, dependability, and a habit of thorough documentation; capable of following runbooks and escalating issues appropriately.

• Willingness to engage in a shared support/backup rotation for time-sensitive loads and deliverables.

• Experience with dbt, Python for data tasks, Azure (Data Factory, storage/data lake), or Couchdrop-style file automation is advantageous.

• Knowledge of data modeling, data vault, or warehouse monitoring and alerting is beneficial.

• Experience in healthcare, pharmacy benefit management (PBM), or claims/eligibility data, alongside an understanding of PHI/HIPAA regulations.

• Familiarity with pharmacy data concepts (NDC, eligibility, accumulators, formulary) is a plus.

• Fully remote position; reliable internet connection and an appropriate home work environment are required.

• Occasional off-hours support may be necessary for urgent loads, client files, or incident responses.

• Willingness and ability to travel (10%-20%).

🏝️ Benefits

• Competitive compensation package, which includes health, dental, vision, and other benefits.