Data Engineer, ADF, Snowflake

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and sustain ETL/ELT data pipelines utilizing Azure Data Factory (ADF).

• Create and enhance data solutions employing Snowflake as the cloud data warehouse.

• Build data transformation models leveraging dbt (Data Build Tool).

• Write intricate and optimized SQL queries, stored procedures, views, and transformations.

• Develop data pipelines for ingesting data from APIs, databases, files, and enterprise applications.

• Execute data cleansing, transformation, validation, and reconciliation to guarantee data quality and accuracy.

• Implement incremental data loads, scheduling, dependency management, and error handling within ADF.

• Create scalable and optimized Snowflake data models, tables, views, and SQL transformations.

• Construct and maintain dbt models, tests, macros, and documentation.

• Diagnose pipeline failures, data issues, and performance challenges across ADF, Snowflake, and dbt.

• Collaborate with business analysts, data architects, and other engineering teams to comprehend data requirements and deliver solutions.

• Assist with production deployments, monitoring, and continuous improvement of data pipelines.

⛳️ Requirements

• Over 4 years of experience in Data Engineering.

• Substantial hands-on experience with Azure Data Factory (ADF), Snowflake, dbt, and Advanced SQL.

• Strong grasp of ETL/ELT concepts and data warehousing principles.

• Experience in developing complex data pipelines and transformations.

• Solid understanding of dimensional data modeling, including fact and dimension tables.

• Experience with Snowflake performance optimization and query tuning.

• Practical experience with dbt models, tests, incremental models, macros, and Jinja.

• Excellent troubleshooting and production support capabilities.

• Familiarity with Azure cloud services, especially Azure Storage, Azure Functions, Databricks, or Key Vault (preferred).

• Experience in integrating data via REST APIs, JSON, CSV, and relational databases (preferred).

• Knowledge of Python or PySpark (a plus).

• Experience with Git and CI/CD using Azure DevOps or similar tools (preferred).

• Understanding of data governance, quality, and security best practices (preferred).

• Experience working with large-scale enterprise data platforms (preferred).

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health benefits including medical, dental, and vision.

• Flexible working hours and remote work options.

• Opportunities for professional development and training.

• Supportive team environment with a focus on collaboration.