Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and sustain ETL/ELT pipelines that ingest and transform data from databases, APIs, and scheduled SFTP file deliveries.

• Construct and oversee GCP data infrastructure to ensure performance, scalability, availability, and security.

• Integrate data between on-premises and cloud environments, facilitating scheduled batch processing and incremental data loads.

• Create structured data models and curated datasets aimed at analytics, reporting, and downstream applications.

• Implement data quality checks, monitor pipelines, handle errors, and establish recovery processes.

• Automate manual tasks, enhance SQL and pipeline performance, and manage cloud resource expenditures.

• Collaborate with business, product, analytics, leadership, executive, data, and design teams to translate requirements into effective data solutions and troubleshoot technical issues.

• Enable the analysis of operational efficiency and metrics related to customer acquisition.

• Develop and operationalize machine learning models for forecasting and route optimization.

• Maintain comprehensive documentation for data pipelines, architecture, source integrations, and operational procedures.

• Identify and execute internal process enhancements and redesign infrastructure to support scalability and optimized data delivery.

⛳️ Requirements

• A minimum of 5 years of relevant, hands-on experience in building and supporting production data pipelines on GCP.

• Proficient in SQL and Python for data extraction, transformation, integration, and automation.

• Practical experience with BigQuery and Cloud Storage, along with relevant GCP orchestration and data processing services.

• Experience in integrating data from on-premises databases, cloud-hosted systems, REST APIs, and SFTP file transfers.

• A solid understanding of data modeling, ETL/ELT patterns, incremental loading, and data quality practices.

• Familiarity with access controls, service accounts, secrets management, and secure connectivity across both on-premises and cloud environments.

• Experience with version control, automated deployments, and troubleshooting in production environments.

• Excellent communication skills with the ability to engage with both technical and business stakeholders.

• Preferred experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.

• Familiarity with infrastructure as code and CI/CD practices is an advantage.

• Desirable experience in forecasting, optimization methods, and deploying or monitoring machine learning models.

🏝️ Benefits

• Medical, dental, and vision insurance.

• Life insurance and short- and long-term disability coverage.

• 401(k) retirement savings plan with a company match.

• Flexible vacation policy in states other than CA, CO, IL, MA, MT, and NE, with accruals of up to 96 hours in the first year of employment, increasing to 160 hours based on tenure.

• Two (2) floating holidays each year.

• Paid sick leave.

• Six (6) paid company holidays.

• Two (2) weeks of paid pregnancy disability leave.

• Four (4) weeks of paid parental bonding leave.

• Additional wellness and employee assistance programs.

• Bonus, commission, or other incentive compensation may be available in accordance with the applicable plan.