ETL Developer, Azure Data Factory, MS Fabric

This is a fully remote position, open to applicants in South Carolina.

📋 Description

• Design, develop, and sustain ETL/ELT processes aimed at enterprise reporting and analytics.

• Construct source-to-stage and stage-to-data warehouse data pipelines.

• Develop and uphold data transformation logic, mappings, and business rules.

• Create and enhance database views, stored procedures, and SQL scripts.

• Integrate data from diverse sources including databases, APIs, file systems, and third-party applications.

• Implement error handling, logging, monitoring, and recovery mechanisms within ETL workflows.

• Support data warehouse architecture and initiatives related to data modeling.

• Ensure data quality, consistency, and integrity throughout the data lifecycle.

• Conduct data validation, reconciliation, and root cause analysis.

• Collaborate with business analysts and stakeholders to convert requirements into technical solutions.

• Document data flows, mappings, technical specifications, and operational procedures.

• Develop and manage workflow scheduling and orchestration processes.

• Configure job dependencies, alerts, notifications, and automated recovery procedures.

• Monitor ETL jobs and pinpoint performance bottlenecks.

• Support production deployments and post-deployment validation tasks.

• Troubleshoot ETL failures and resolve data quality issues.

• Participate in code reviews and comply with development standards.

• Suggest enhancements to data integration processes and system performance.

• Assist with production incidents and conduct impact analysis as required.

⛳️ Requirements

• Over 3 years of experience in developing ETL/ELT solutions.

• Strong expertise in SQL and relational database platforms.

• Experience in data warehouse concepts, dimensional modeling, and data integration.

• Proficient with ETL tools such as Azure Data Factory and Microsoft Fabric.

• Excellent analytical and problem-solving abilities.

• Experience working with APIs, flat files, XML, JSON, and various other data formats.

• Familiarity with data lake and lakehouse architectures is preferred.

• Experience with workflow scheduling tools like Redwood RunMyJobs or equivalent is preferred.

• Familiarity with ServiceNow is preferred.

• Knowledge of Power BI and enterprise reporting platforms is preferred.

• Basic understanding of Linux is preferred.

• Experience with Change Data Capture (CDC) and real-time data integration is preferred.

• Understanding of DevOps, CI/CD, and source control tools is preferred.

🏝️ Benefits

• Flexible time off policy.

• 401K company match up to 4% (dollar for dollar).

• Professional development, training, and tuition reimbursement programs.

• Options for medical, dental, vision, and life insurance coverage.

• Opportunities for career advancement.