Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and maintain ETL/ELT pipelines that ingest and transform data from various sources including databases, APIs, and scheduled SFTP file deliveries.

• Construct and oversee GCP data infrastructure focusing on performance, scalability, availability, and security measures.

• Integrate data across both on-premises and cloud environments for scheduled batch processing as well as incremental data loads.

• Create structured data models and curated datasets intended for analytics, reporting, and downstream applications.

• Implement data quality checks, monitor pipelines, manage error handling, and establish recovery processes.

• Automate manual tasks, enhance SQL and pipeline performance, and oversee cloud resource expenses.

• Collaborate with teams across business, product, analytics, leadership, executive, data, and design to convert requirements into effective data solutions and troubleshoot technical challenges.

• Facilitate the analysis of operational efficiency and metrics related to customer acquisition.

• Develop and operationalize machine learning models aimed at forecasting and optimizing routes.

• Maintain comprehensive documentation for pipelines, architecture, source integrations, and operational methodologies.

• Identify and implement enhancements to internal processes and scalable infrastructure redesigns.

• Construct analytical tools utilizing data pipelines to deliver actionable insights for the business.

⛳️ Requirements

• A minimum of 5 years of relevant, hands-on experience in building and supporting production data pipelines on GCP.

• Proficient in SQL and Python for data extraction, transformation, integration, and automation tasks.

• Practical experience with BigQuery and Cloud Storage, along with relevant GCP orchestration and data processing services.

• Expertise in integrating data from on-premises databases, cloud-hosted systems, REST APIs, and SFTP file transfers.

• Solid understanding of data modeling, ETL/ELT methodologies, incremental loading, and data quality standards.

• Familiarity with access controls, service accounts, secrets management, and secure connectivity between on-premises and cloud environments.

• Experience utilizing version control, executing automated deployments, and troubleshooting in production environments.

• Excellent communication skills with the ability to engage effectively with both technical and business stakeholders.

• Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer is preferred.

• Knowledge of infrastructure as code and CI/CD practices is advantageous.

• Experience with forecasting, optimization techniques, and deploying or monitoring machine learning models is a plus.

🏝️ Benefits

• Medical, dental, and vision insurance.

• Life insurance and short- and long-term disability coverage.

• 401(k) retirement savings plan with company matching contributions.

• Flexible vacation policy (not applicable in CA, CO, IL, MA, MT, and NE), with accruals up to 96 hours in the first year, increasing to 160 hours based on tenure.

• Two (2) floating holidays each year.

• Paid sick leave.

• Six (6) paid company holidays.

• Two (2) weeks of paid pregnancy disability leave.

• Four (4) weeks of paid parental bonding leave.

• Additional wellness initiatives and employee assistance programs.

• Opportunities for bonus, commission, or other incentive compensation may be available in accordance with the applicable plan.