ETL Developer – Azure Data Factory, MS Fabric

This is a fully remote position, open to applicants in South Carolina.

📋 Description

• Design, develop, and maintain ETL/ELT processes to facilitate enterprise reporting and analytics.

• Create data pipelines for source-to-stage and stage-to-data warehouse transitions.

• Establish and uphold data transformation logic, mappings, and business rules.

• Develop and enhance database views, stored procedures, and SQL scripts.

• Integrate data from various sources including databases, APIs, file systems, and third-party applications.

• Implement error handling, logging, monitoring, and recovery procedures within ETL workflows.

• Support the architecture of enterprise data warehouses and engage in data modeling initiatives.

• Ensure data quality, consistency, and integrity throughout the entire data lifecycle.

• Conduct data validation, reconciliation, and root cause analysis as necessary.

• Collaborate with business analysts and stakeholders to convert requirements into technical solutions.

• Document data flows, mappings, technical specifications, and operational procedures.

• Develop and manage workflow scheduling and orchestration processes.

• Configure job dependencies, alerts, notifications, and automated recovery processes.

• Monitor ETL jobs and proactively address any performance bottlenecks.

• Support production deployments and engage in post-deployment validation activities.

• Troubleshoot ETL failures and address data quality issues.

• Participate in code reviews and ensure adherence to development standards.

• Suggest enhancements to data integration processes and overall system performance.

• Assist with production incidents and conduct impact analysis as required.

⛳️ Requirements

• Minimum of 3 years of experience in developing ETL/ELT solutions.

• Strong proficiency in SQL and relational database platforms.

• Familiarity with data warehouse concepts, dimensional modeling, and data integration techniques.

• Experience with ETL tools like Azure Data Factory & Fabric.

• Robust analytical and problem-solving capabilities.

• Experience working with APIs, flat files, XML, JSON, and various other data formats.

• Understanding of data lake and lakehouse architectures.

• Familiarity with workflow scheduling tools such as Redwood RunMyJobs or equivalent.

• Experience using Service Now.

• Knowledge of Power BI and enterprise reporting platforms.

• Basic familiarity with Linux systems.

• Experience with Change Data Capture (CDC) and real-time data integration.

• Understanding of DevOps practices, CI/CD processes, and source control tools.

🏝️ Benefits

• Flexible time off policy.

• 401K Company match (up to 4% - dollar for dollar).

• Opportunities for professional development, training, and tuition reimbursement programs.

• Comprehensive medical, dental, vision, and life insurance policy options.

• Pathways for career advancement with a leading company in the industry!