Lead Data Engineer – ETL/ELT

This is a fully remote position, open to applicants in Arizona, +3 more states.

📋 Description

• Design, construct, and manage data pipelines utilizing Medallion Architecture spanning Bronze, Silver, and Gold layers.

• Take ownership of ingestion, transformation, governance, testing, and publishing layers.

• Ensure the reliability, scalability, performance, and cost-effectiveness of pipelines.

• Implement Change Data Capture (CDC) and batch ingestion utilizing Qlik Replicate.

• Develop ingestion patterns for databases, files, and APIs.

• Create reusable components and frameworks for pipelines based on Python.

• Develop dbt models using advanced SQL and Jinja templating techniques.

• Implement automated testing for data quality, schema validation, and data freshness.

• Facilitate CI/CD-driven transformation deployments.

• Implement Snowpipe, Tasks, Streams, and Stored Procedures.

• Design and enforce Role-Based Access Control (RBAC), dynamic masking, and tag-based access control measures.

• Ensure data security and compliance through platform-level controls.

• Build and deploy data components using AWS services such as S3, Lambda, ECS Fargate, Glue, DynamoDB, and IAM, or equivalent services in Azure.

• Collaborate on CI/CD, infrastructure automation, and environment promotion efforts.

• Act as a technical leader and mentor for junior and mid-level data engineers.

• Lead design discussions, code reviews, and make technical decisions.

• Establish and uphold engineering best practices and standards.

⛳️ Requirements

• Bachelor’s Degree with at least 6 years of experience in Advanced Data Engineering, data technologies, cloud platforms, and project or technical leadership, OR a High School Diploma or GED with a minimum of 10 years of experience in the same fields.

• Extensive, hands-on production experience in designing, building, and operating production-grade data platforms.

• Production experience with modern ELT architectures, Snowflake, dbt, Qlik Replicate, Python-based pipeline development, and cloud-native services.

• Expertise in designing and operating data pipelines based on Medallion Architecture.

• Experience with CDC and batch data ingestion through Qlik Replicate.

• Development of custom Python data pipelines.

• Familiarity with dbt Mesh Architecture.

• Experience with dbt Cloud transformations, testing, SQL, and Jinja templating.

• Knowledge of Snowflake features including Snowpipe, Tasks, Streams, and Stored Procedures.

• Understanding of Snowflake governance including RBAC, tokenization, dynamic data masking, and tag-based access control.

• Involvement in release management, code deployment, and disaster recovery activities.

• Experience in cloud development using AWS or equivalent Azure services.

• Ability to mentor junior and mid-level data engineers.

• Capability to lead design discussions, code reviews, and technical decision-making processes.

🏝️ Benefits

• Competitive, thoughtfully designed, and high-quality benefits program.

• Benefits information available at https://jobs.firstcitizens.com/benefits.