Senior Data Engineer

This is a fully remote position, open to applicants in Alabama, +44 more locations.

📋 Description

• Design, develop, and sustain GCP data pipelines utilizing BigQuery, Cloud Spanner, and Dataflow.

• Create and support ETL/ELT workflows across Oracle, Spanner, SQL Server, PostgreSQL, and various other relational databases.

• Develop and enhance BigQuery datasets, tables, partitioning, and clustering strategies.

• Implement and optimize Dataflow pipelines for transformation, enrichment, and data movement.

• Oversee and manage Compute Engine VMs, focusing on CPU utilization, resource allocation, and performance tuning.

• Support Cloud Storage, Cloud Composer, Pub/Sub, and IAM throughout end-to-end data workflows.

• Apply dimensional modeling techniques, including star/snowflake schemas, slowly changing dimensions, and data mart design.

• Develop and maintain Informatica ETL workflows that integrate GCP and on-premise databases.

• Operate in Unix/Linux environments, including shell scripting, permissions management, and log/file handling.

• Schedule, monitor, and troubleshoot batch jobs using Control-M.

• Engage in Agile/JIRA processes, encompassing sprint planning, ticket tracking, status updates, and defect management.

• Collaborate with senior engineers and architects on performance tuning, query optimization, and database design.

• Diagnose pipeline failures, performance bottlenecks, and data quality issues.

• Document technical designs, operational runbooks, and support procedures.

• Utilize AI/ML and GenAI tools to enhance productivity and streamline engineering workflows.

⛳️ Requirements

• Over 5 years of experience in data engineering, software engineering, or database development.

• More than 3 years of hands-on experience with Google Cloud Platform products, particularly BigQuery, Cloud Spanner, and Dataflow.

• Extensive experience with Oracle, Spanner, SQL, and PostgreSQL.

• Practical knowledge of Compute Engine/VMs, Cloud Storage, Cloud Composer, Pub/Sub, and other essential GCP services.

• Experience in performance tuning, CPU utilization analysis, and resource optimization on GCP compute resources.

• Understanding of dimensional modeling, fact/dimension tables, and ETL design patterns.

• Familiarity with Informatica.

• Strong Unix/Linux experience, including shell scripting and file system management.

• Experience with Control-M.

• Proficient SQL development skills with the ability to write and optimize complex queries.

• Bachelor’s degree or equivalent experience (High School Diploma with 4 years of relevant experience).

🏝️ Benefits

• CVS Health bonus, commission, or short-term incentive program in addition to base salary.

• Medical coverage.

• Dental coverage.

• Vision coverage.

• Paid time off.

• Retirement savings options.

• Wellness programs.

• Additional resources supporting physical, emotional, and financial well-being, subject to eligibility.