Senior Data Engineer

This is a fully remote position, open to applicants in North Carolina.

📋 Description

• Design, develop, and sustain GCP data pipelines utilizing BigQuery, Cloud Spanner, and Dataflow.

• Construct and support ETL/ELT workflows across Oracle, Spanner, SQL Server, PostgreSQL, and various other relational databases.

• Create and enhance BigQuery datasets, tables, partitioning, and clustering approaches.

• Implement and refine Dataflow pipelines for transformation, enrichment, and data movement.

• Oversee and manage Compute Engine VMs, focusing on CPU utilization, resource allocation, and performance optimization.

• Assist with Cloud Storage, Cloud Composer, Pub/Sub, and IAM in complete data workflows.

• Utilize dimensional modeling, star/snowflake schemas, slowly changing dimensions, and data mart design principles.

• Develop and maintain Informatica ETL workflows that integrate GCP and on-premise systems.

• Operate in Unix/Linux environments with shell scripting, permissions management, and log/file handling.

• Schedule, monitor, and resolve issues with batch jobs using Control-M.

• Engage in Agile/JIRA processes, including sprint planning, ticket tracking, status updates, and defect management.

• Collaborate with senior engineers and architects on performance tuning, query optimization, and database design.

• Diagnose pipeline failures, performance bottlenecks, and data quality challenges.

• Document technical designs, operational runbooks, and support procedures.

• Employ AI/ML and GenAI tools to enhance productivity and streamline engineering workflows.

⛳️ Requirements

• Over 5 years of experience in data engineering, software engineering, or database development.

• More than 3 years of practical experience with Google Cloud Platform, particularly BigQuery, Cloud Spanner, and Dataflow.

• Extensive experience with Oracle, Spanner, SQL, and PostgreSQL.

• Familiarity with Compute Engine/VMs, Cloud Storage, Cloud Composer, and Pub/Sub.

• Proven experience in performance tuning, CPU utilization assessment, and resource optimization on GCP computing resources.

• Knowledge of data warehousing concepts, dimensional modeling, fact/dimension tables, and ETL design patterns.

• Experience with Informatica.

• Strong background in Unix/Linux, including shell scripting and file system management.

• Proficiency with Control-M.

• Excellent SQL development skills and the ability to write and optimize complex queries.

• Bachelor's degree or equivalent experience (High School Diploma and 4 years of relevant experience).

🏝️ Benefits

• Medical coverage.

• Dental coverage.

• Vision coverage.

• Paid time off.

• Retirement savings options.

• Wellness programs.

• Comprehensive benefits package supporting physical, emotional, and financial well-being.

• CVS Health bonus, commission, or short-term incentive program in addition to base pay.