Enterprise Data Warehouse ETL/Data Engineer

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Design and create reusable, parameter-driven ingestion and transformation pipelines.

• Construct and sustain medallion architecture solutions.

• Develop efficient ELT workflows.

• Craft and enhance PySpark notebooks and distributed processing jobs.

• Design dimensional data models.

• Implement data vault patterns.

• Optimize distributed SQL workloads.

• Establish CI/CD processes.

• Develop monitoring, logging, and auditing solutions.

• Lead or participate in cloud modernization initiatives.

⛳️ Requirements

• Profound hands-on expertise in Azure Data Factory.

• Significant experience with Azure Databricks and PySpark.

• Production experience in Azure Synapse Analytics.

• Strong understanding of Azure Data Lake Storage Gen2.

• Familiarity with Azure Key Vault and Azure AD / Entra ID.

• Experience in monitoring and troubleshooting data solutions.

• Advanced SQL capabilities.

• Strong skills in Python.

• Proficient in T-SQL and acquainted with Spark SQL.

🏝️ Benefits

• Health insurance.

• Professional development opportunities.