Senior Data Engineer, DBT

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement Directed Acyclic Graphs (DAGs) along with custom operators and hooks for Airflow.

• Engage with cloud technologies and distributed computing environments such as Azure, Google Cloud Platform (GCP), or AWS.

• Execute Business Intelligence, Data Warehousing, and ETL initiatives.

• Create solutions using Python and SQL for data processing and manipulation.

• Utilize version control systems, CI/CD practices, and automation tools.

• Conduct activities related to data quality and cleansing.

• Articulate technical concepts effectively to both technical and non-technical stakeholders.

• Distill complex analyses into actionable insights for the business.

• Participate in an on-call escalation rotation as required.

• Foster collaboration across teams and build strong working relationships.

• Develop Snowflake SQL queries and Python scripts for Extract, Load, and Transform (ELT) processes.

• Leverage Snowflake utilities, including Snow SQL, Snow Pipe, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.

• Manage intricate data workflows utilizing Apache Airflow.

• Execute data modeling and source-to-target mapping tasks.

• Create ETL solutions leveraging DBT, Advanced SQL, and Python scripting.

⛳️ Requirements

• Over 8 years of practical experience in software development.

• Bachelor’s degree in a related field.

• Proven experience in creating DAGs and developing custom operators and hooks for Airflow.

• Strong expertise in Azure, Google Cloud Platform (GCP), or AWS along with distributed computing.

• Hands-on experience with Business Intelligence (BI), Data Warehousing, and ETL projects.

• Extensive knowledge of Python and SQL.

• Familiarity with version control systems, CI/CD processes, and automation tools.

• Experience in ensuring data quality and performing data cleansing tasks.

• Excellent verbal and written communication skills.

• Ability to translate complex analyses into actionable business insights.

• Willingness to participate in an on-call escalation rotation as necessary.

• Strong teamwork and collaboration skills.

• Proficiency in DBT and Snowflake SQL.

• Practical experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.

• Strong problem-solving abilities.

• Practical experience with Apache Airflow.

• Analytical, creative, and self-driven.

• Advanced SQL skills accompanied by solid Python scripting capabilities.

• Competence in data modeling and source-to-target mapping.

• Exceptional SQL coding proficiency.

🏝️ Benefits

• Comprehensive health and wellness programs.

• Competitive salary and performance-based bonuses.

• Opportunities for professional development and continuous learning.

• Flexible working arrangements and a positive work-life balance.

• Supportive team culture and collaborative work environment.