ETL Data Engineer, Python, Snowflake

This is a fully remote position, open to applicants in Pennsylvania.

📋 Description

• Design, develop, and maintain scalable ETL/ELT data pipelines utilizing Python (PySpark), Snowflake, and cloud-native integration technologies.

• Create reliable, efficient, and reusable processes for data ingestion, transformation, and loading aimed at enterprise analytics and reporting.

• Architect, construct, and enhance modern Snowflake cloud data solutions.

• Implement and oversee Snowflake databases, schemas, tables, views, streams, tasks, stages, and stored procedures.

• Utilize Snowflake virtual warehouses, data sharing, time travel, and automated scaling to enhance performance and cost-efficiency.

• Design and execute scalable enterprise data warehouse solutions using dimensional modeling, star schemas, facts, and dimensions.

• Extract and ingest data from REST APIs, relational databases, SaaS applications, flat files, and cloud storage platforms.

• Develop and sustain ingestion frameworks for structured and semi-structured data.

• Contribute to data lakes, lakehouses, data mesh architectures, enterprise data catalogs, and integrations between Snowflake and Azure/cloud-native services.

• Collaborate with data architects and business stakeholders on both logical and physical data models.

• Establish and uphold data engineering standards and best practices.

• Implement automated data quality controls, validation frameworks, and monitoring processes.

• Support data governance initiatives and organizational standards.

• Monitor and optimize Snowflake workloads, ETL/ELT processes, and SQL queries.

• Analyze warehouse utilization and suggest improvements for performance and cost-efficiency.

• Monitor pipelines and platform operations, troubleshoot issues, and implement long-term reliability solutions.

• Support production environments and engage in incident resolution.

• Maintain documentation for pipelines, data flows, transformations, data models, and operational processes.

• Partner with cross-functional teams to comprehend requirements and deliver technical data expertise.

• Implement access controls, masking policies, governance frameworks, and other security, privacy, and compliance measures.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related field; or equivalent professional experience.

• Relevant certifications such as SnowPro, Azure Data Engineer Associate, or other cloud data platform certifications are advantageous.

• Demonstrated experience in developing data pipelines for extracting, transforming, and loading data from REST APIs, relational databases, cloud storage, and flat-file sources.

• Familiarity with Snowflake features, including virtual warehouses, streams, tasks, stages, Snowpipe, secure data sharing, and performance optimization.

• Advanced SQL development skills, encompassing complex queries, performance tuning, and optimization of large-scale data workloads.

• Experience with dimensional modeling, star schemas, fact tables, and dimension tables.

• Understanding of cloud-based data ecosystems and integration services, particularly in Microsoft Azure.

• Proficiency with Git and Azure DevOps or similar platforms for source code and CI/CD pipelines.

• Knowledge of data integration best practices, data governance frameworks, and enterprise data management principles.

• Strong analytical and problem-solving abilities with exceptional attention to detail.

• Excellent verbal and written communication skills, with the ability to work collaboratively in a fast-paced environment with shifting priorities.

• Experience with big data technologies, machine learning, data science platforms, or advanced analytics is preferred.

• Familiarity with Power BI, Tableau, or similar data visualization tools is a plus.

• Experience with Agile delivery methodologies and DevOps practices is desirable.

• Preferred technologies include Snowflake, Python/PySpark, SQL, Azure Data Lake Storage, Azure Data Factory or equivalent orchestration tools, Azure Key Vault, Git/Azure DevOps, Power BI, REST APIs, CI/CD, and Terraform.

🏝️ Benefits

• Healthcare coverage.

• Mental health resources.

• Health & fitness reimbursement program.

• Wellness Rewards Program.

• Tuition and certification reimbursement programs.

• Continual education and development trainings.

• Paid time off to volunteer.

• Compensation for referring qualified candidates who join the team.

• Adoption reimbursement program.

• Paid time off for new parents and newlyweds.

• Travel support for nursing parents.

• Employer contributions to retirement programs.

• Employee stock purchasing plan.