Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and sustain data ingestion pipelines, transformation workflows, and data quality protocols within Microsoft Fabric.

• Implement and oversee Bronze, Silver, and Gold medallion architecture layers for designated data domains.

• Extract, transform, and load data from student information, HR/personnel, financial, logistics, IT service management, and operational systems.

• Create ETL and ELT pipelines into the Microsoft Fabric Lakehouse.

• Construct and maintain data integration pipelines, API connections, and automated synchronization workflows.

• Develop Ed-Fi REST API integrations and mappings from Aspen to Ed-Fi, along with descriptor customization, transformation logic, and synchronization.

• Conduct source-system data profiling, mapping, cleansing, transformation, reconciliation testing, and validation.

• Identify and resolve data quality, pipeline, and integration challenges.

• Create SQL queries, Python, or PySpark processing logic, and reusable transformation components.

• Assist in data population, migration, and planning for Ed-Fi Data Management Service migration.

• Generate and maintain technical documentation.

• Collaborate with data architects, analysts, governance experts, application teams, and source-system stakeholders.

• Facilitate knowledge transfer and support operational transition activities.

⛳️ Requirements

• Proven experience in developing data pipelines, ETL/ELT processes, and data integrations.

• Familiarity with Microsoft Fabric, Azure Data Factory, or similar cloud data platforms.

• Advanced SQL skills, including querying, transformation, validation, and troubleshooting.

• Experience with Python and/or PySpark for data engineering tasks.

• Background in working with structured and semi-structured enterprise data.

• Knowledge of cloud-based data lake, lakehouse, or data warehouse architectures.

• Proficiency in data mapping, profiling, reconciliation testing, and quality assurance processes.

• Experience in system integration through REST APIs or comparable application interfaces.

• Ability to document data flows, pipeline setups, mappings, and technical procedures.

• Strong troubleshooting, analytical, and communication abilities.

• Active Secret clearance.

• Preferred: Experience with Microsoft Fabric Lakehouse architecture.

• Preferred: Experience in implementing Bronze, Silver, and Gold medallion data architectures.

• Preferred: Familiarity with the Ed-Fi Data Standard, Ed-Fi ODS/API, or Ed-Fi REST APIs.

• Preferred: Experience in Aspen-to-Ed-Fi mapping or integrating other student information systems with Ed-Fi.

• Preferred: Experience with HR/DCPDS, financial, logistics, or IT service management data.

• Preferred: Experience in supporting large-scale cloud data migrations or modernization projects.

• Preferred: Understanding of data governance, metadata management, lineage, and enterprise data quality practices.

🏝️ Benefits

• Company-sponsored certifications aligned with current and future program work, including cloud, Kubernetes, DevSecOps, security, AI/ML, project management, and related technical areas.

• Clear advancement pathways and future leadership opportunities.

• 401(k) plan with 100% match up to 6%.

• Comprehensive coverage for medical, dental, vision, life, and disability.

• Generous paid time off and holiday benefits.

• Home-office equipment plan and support for remote work.

• Fitness and wellness reimbursement.

• Weekly pay schedule.

• Modern perks, including team events.