Lead Data Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the assessment and documentation of the current data platform architecture (Snowflake, Airflow, AWS).

• Create the architecture for the future data platform by adhering to contemporary ELT and dbt best practices.

• Establish standards in areas such as data modeling, pipeline architecture, transformation frameworks, governance, and data quality.

• Guide the transition of transformation logic into dbt models.

• Define architectural patterns for staging layers, intermediate layers, and data marts.

• Implement automated testing frameworks within dbt.

• Facilitate discovery sessions and technical workshops with the client's data engineering teams.

• Document architecture, pipelines, and operational processes.

• Conduct architecture walkthroughs during knowledge transfer phases.

• Set standards for CI/CD, monitoring frameworks, and data quality validation.

• Establish best practices for schema management and governance.

• Optimize Snowflake compute usage and enhance platform performance.

• Design scalable orchestration strategies for Airflow pipelines.

• Enhance platform reliability, monitoring, and operational observability.

⛳️ Requirements

• A minimum of 10 years of experience in Data Engineering or Data Architecture.

• Significant experience in designing and implementing modern data platforms.

• Expert-level proficiency with Snowflake.

• Strong background in implementing dbt transformation frameworks.

• Advanced skills in SQL modeling and performance optimization.

• Extensive experience with Apache Airflow orchestration.

• Strong programming abilities in Python.

• Experience in designing ELT pipelines, data warehouse architectures, transformation frameworks, and large-scale data pipelines.

• Familiarity with working in cloud environments, preferably AWS.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health and wellness benefits.

• Opportunities for professional development and career advancement.

• Flexible work environment and remote work options.

• Collaborative and inclusive company culture.