ADF Lead, Data Bricks, Snowflake

This is a fully remote position, open to applicants in Oregon.

📋 Description

• Designing and developing the data ingestion pipeline.

• Creating, constructing, and maintaining expansive and intricate data processing pipelines utilizing Databricks and Azure Data Factory within the Azure environment to satisfy enterprise data demands.

• Offering operational and functional assistance in the creation, storage, management, and maintenance of enterprise data.

• Recognizing, designing, and executing internal process enhancements.

• Establishing the infrastructure necessary for the extraction, transformation, and loading of data from a diverse range of cloud and on-premises data sources.

• Collaborating with stakeholders to assist with data-related technical challenges and support their data infrastructure requirements.

• Partnering closely with data architecture, data governance, and data analytics teams to ensure that pipelines comply with enterprise standards for usability and performance.

⛳️ Requirements

• Over 10 years of experience.

• Proficient in building a metadata-driven framework using Databricks.

• Experience with Snow-Pipe and Snow-SQL.

• Ability to write complex SQL queries, stored procedures, and user-defined functions in Snowflake to facilitate data processing and analytical needs.

• Skilled in optimizing SQL code and query performance by understanding query execution plans, indexing strategies, and query optimization techniques.

• Capable of implementing data quality checks and validation processes to ensure the accuracy, consistency, and integrity of data in Snowflake.

• Experience collaborating with data governance teams to uphold data quality standards and ensure compliance with data regulations.

• Knowledgeable in implementing and maintaining data security measures in Snowflake to guarantee data privacy and compliance.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health and wellness benefits.

• Flexible work arrangements and remote work opportunities.

• Professional development and continuous learning opportunities.

• Collaborative and inclusive company culture.