Senior Data Engineer – ETL/ELT

This is a fully remote position, open to applicants in Arizona, +2 more states.

📋 Description

• Design and construct data pipelines utilizing established Medallion Architecture patterns (Bronze, Silver, Gold)

• Implement batch and CDC-based ingestion pipelines from databases, files, and APIs

• Ensure pipeline reliability, scalability, performance, and cost efficiency

• Develop and maintain ingestion pipelines with Qlik Replicate for snapshot and CDC methodologies

• Create ingestion processes for both structured and semi-structured data

• Build and enhance Python-based pipeline components in alignment with existing frameworks

• Develop dbt models using SQL and Jinja templating

• Implement and sustain automated tests for data quality, freshness, and schema validation

• Engage in CI/CD-based deployments of dbt transformations

• Apply Snowflake ingestion patterns utilizing Snowpipe and Tasks

• Enforce and support RBAC, dynamic masking, and tag-based access controls

• Create stored procedures and uphold governed data access patterns

• Develop and manage data workloads leveraging AWS services such as S3, Lambda, ECS Fargate, Glue, DynamoDB, and IAM, or equivalent Azure services

• Collaborate with senior engineers on deployment pipelines, automation, and environment promotion

• Diagnose data pipeline issues and contribute to production support

• Implement logging, monitoring, and alerting for pipelines and data processes

• Contribute to efforts aimed at performance tuning and cost optimization

• Mentor junior data engineers through code reviews and technical guidance

• Work alongside Lead Data Engineers on design and implementation decisions

• Partner with stakeholders to translate requirements into technical solutions

⛳️ Requirements

• Bachelor's Degree and 4 years of experience in Data Engineering, data technologies, cloud platforms OR a High School Diploma or GED and 8 years of experience in Data Engineering, data technologies, cloud platforms

• Practical experience in constructing and managing modern data pipelines on a cloud-based data platform

• Familiarity with building data pipelines using Medallion Architecture patterns

• Experience with Qlik Replicate for snapshot, CDC, and batch ingestion

• Proficiency in Python development for data pipeline components

• Experience with dbt Cloud modeling, testing, and SQL development

• Knowledge of Snowflake ingestion and processing using Snowpipe, Tasks, and Stored Procedures

• Understanding of RBAC and data masking concepts in Snowflake

• Cloud-native development expertise on AWS or equivalent Azure platforms

• Experience with CI/CD pipelines like GitLab and GitHub Actions

• Familiarity with observability and monitoring tools such as Splunk or Dynatrace

• Experience in regulated or governance-heavy settings

• Snowflake AI development experience using Cortex CoCo

• Relevant cloud or data platform certifications are preferred

• Capability to independently deliver complex pipeline components

• Ability to collaborate effectively with Lead Data Engineers

• Ability to mentor junior engineers

• Experience with AWS services including S3, Lambda, ECS Fargate, Glue, DynamoDB, and IAM, or equivalent Azure services

🏝️ Benefits

• Competitive, thoughtfully designed, and high-quality benefits program

• Benefits information available at https://jobs.firstcitizens.com/benefits