Senior Data Architect – Snowflake, Market Research

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Take ownership of the design, modeling, ingestion, and optimization of a comprehensive Snowflake and dbt platform.

• Create and construct scalable core tables that transform raw event data into reliable, well-structured datasets.

• Develop incremental dbt models for billion-row tables utilizing merge strategies, clustering, deduplication, microbatch processing, and idempotent reprocessing techniques.

• Implement solutions for identity resolution that manage merged identities, late-arriving data, and duplicate events.

• Design fact and dimension marts and establish approved datasets for BI developers, analysts, and data scientists.

• Tackle complex SQL challenges related to performance, accuracy, window functions, and semi-structured data.

• Create ingestion processes from Amazon S3 into Snowflake using Snowpipe, stages, storage integrations, COPY INTO commands, and handle schema evolution.

• Collaborate with software engineers to define event-driven delivery patterns, schemas, data contracts, and columnar formats like Parquet.

• Manage Snowflake environments, including role-based access control, security policies, integrations, and warehouse configurations.

• Oversee pipeline stability, load failures, data freshness, late-arriving events, and duplicate files.

• Enhance the performance and cost-effectiveness of Snowflake and dbt through clustering, materialization strategies, warehouse sizing, query profiling, and scheduling.

• Set data-modeling and dbt standards while reviewing complex SQL, dbt, and Python code.

• Generate design documentation, assess architectural trade-offs, and mentor engineers and analysts.

⛳️ Requirements

• Over 6 years of experience in Data Engineering, Data Architecture, or Analytics Engineering.

• More than 3 years of practical experience in building production solutions with Snowflake.

• Proficient SQL skills at an expert level.

• Advanced experience in data modeling, including dimensional modeling, fact and dimension marts, slowly changing dimensions, conformed dimensions, and semi-structured data.

• Extensive dbt experience with incremental strategies, snapshots, macros, testing, and handling billion-row datasets.

• Experience with behavioral or event data, particularly in sessionization, identity resolution, late-arriving events, and duplicates.

• In-depth expertise in Snowflake, encompassing RBAC, Snowpipe, stages, storage integrations, COPY INTO, schema inference, tasks, streams, clustering, and cost management.

• Familiarity with AWS services such as S3, IAM, SNS, and SQS.

• Experience in designing event-driven data integrations and working with formats like Parquet.

• Capability to read and review Python code.

• Proven track record of addressing complex data issues from diagnosis to production with minimal supervision.

• Strong written and verbal communication skills in English.

• Ability to articulate architectural decisions and technical trade-offs to both engineers and business leaders.

🏝️ Benefits

• 100% Remote Work

• Highly Competitive USD Pay

• Paid Time Off

• Work with Autonomy

• Collaborate with Leading American Companies

• Engagement Activities

• Support for Work-life Balance

• Cooperation with a diverse, multicultural global network

• Collaboration with experienced senior professionals