Data/ETL Engineer – Journeyman

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Design, maintain, and resolve issues in ETL workflows utilizing SSIS and approved integration tools.

• Execute approved integrations among source systems, APIs, databases, and analytical or reporting platforms.

• Create and uphold SQL transformations, queries, and supporting database routines.

• Leverage Python for the automation of data processing, validation, integration, and routine pipeline tasks.

• Establish raw, standardized, and curated data layers following approved designs and transformation protocols.

• Develop and sustain source-to-target mappings, field mappings, and identifier mappings.

• Construct reconciliation checks to validate record counts, totals, completeness, and transformation accuracy.

• Facilitate incremental loading, processing checkpoints, retries, and controlled reprocessing.

• Apply approved schema modifications and assess their impact on dependent workflows and datasets.

• Preserve data lineage, pipeline documentation, configuration records, and operational instructions.

• Oversee scheduled processing, execution outcomes, data freshness, and pipeline errors.

• Examine failures related to source data, SQL logic, SSIS packages, APIs, and downstream dependencies.

• Document troubleshooting outcomes and escalate complex issues to senior engineers.

• Resolve assigned defects and assist with regression testing, reconciliation, and release validation.

• Maintain version-controlled code and assist with approved deployment and rollback procedures.

• Collaborate with governance, database, BI, AI/ML, and testing teams on data definitions, dependencies, and quality concerns.

• Revise runbooks and technical documentation following pipeline adjustments and operational insights.

⛳️ Requirements

• Active Secret clearance or higher.

• At least six years of relevant professional experience.

• Bachelor’s degree in computer science, information systems, or a related discipline, or an acceptable equivalent.

• Proven experience in the development and maintenance of ETL workflows.

• Experience in supporting SQL Server Integration Services (SSIS).

• Proficiency in SQL, including the development of SQL transformations.

• Experience with Python and API integrations.

• Experience in creating and maintaining data mappings.

• Experience in building and executing reconciliation checks.

• Experience in maintaining pipeline documentation and data lineage.

• Capability to support schema management and troubleshoot data pipelines.

• Ability to implement raw, standardized, and curated data layers.

• CompTIA Security+ CE or another approved IAT Level II certification when pertinent to assigned duties.

• Relevant data engineering certification is preferred.

• Experience in supporting federal or Department of Defense data environments is preferred.

• Experience with data warehouses, analytical datasets, BI platforms, or AI-ready data is preferred.

• Experience implementing incremental loads, checkpoints, retries, and handling failed records is preferred.

• Familiarity with metadata management, data governance, common identifiers, and authoritative sources is preferred.

• Experience in developing automated data-quality and regression checks is preferred.

• Familiarity with version control, CI/CD, deployment automation, and rollback processes is preferred.

• Familiarity with secure API authentication, service accounts, secrets management, and audit logging is preferred.

• Strong skills in troubleshooting, documentation, communication, and cross-team coordination are preferred.

🏝️ Benefits

• Regular full-time employment.

• Opportunity to work remotely.

• Chicago-area candidates preferred.

• Opportunity to support a USMEPCOM ENLIST government contract program.

• Equal Employment Opportunity and Affirmative Action protections.