Data Engineer – Google Cloud Platform, GCP

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Design, develop, and sustain scalable data ingestion pipelines and workflows utilizing Google Cloud Platform.

• Implement and enhance data processing and transformation solutions with BigQuery, Dataform, Pub/Sub, Cloud Storage, and Cloud Composer.

• Create SQL queries to extract, transform, validate, and troubleshoot data across enterprise systems.

• Construct and manage ingestion processes that integrate data from various sources into BigQuery.

• Diagnose pipeline failures, data inconsistencies, and production issues to maintain operational stability.

• Develop and conduct unit, system, integration, and user acceptance testing, documenting outcomes and ensuring solution quality.

• Collaborate with engineering teams, architects, and business stakeholders to convert requirements into effective technical solutions.

• Engage in technical design discussions, code reviews, project planning, and initiatives for continuous improvement.

• Prepare and uphold technical documentation, development specifications, and implementation plans.

• Adhere to security, data governance, and engineering standards while managing sensitive information.

• Participate in an on-call production support rotation, typically one full week every 4-6 weeks.

⛳️ Requirements

• Over 3 years of professional experience in data engineering, data integration, or related technical positions.

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.

• Experience in designing, developing, and maintaining cloud-based data ingestion pipelines.

• Proficient in implementing and supporting data processing workflows within Google Cloud Platform environments.

• Skilled in troubleshooting production data pipelines and resolving data quality or integration challenges.

• Familiarity with software development practices, testing methodologies, and technical documentation.

• Ability to work autonomously and collaborate efficiently with technical teams and business stakeholders.

• Hands-on experience with Google Pub/Sub for event-driven messaging and data ingestion.

• Strong knowledge of BigQuery for data warehousing, querying, and processing.

• Experience with Google Dataform for SQL-based data transformations and workflow management.

• Proven ability in designing and implementing data ingestion processes into BigQuery from multiple sources.

• Familiarity with Google Cloud Storage for cloud-based data storage and integration.

• Knowledge of Cloud Composer (Apache Airflow) for workflow orchestration and scheduling.

• Proficient in using GitHub for version control and collaborative development.

• Strong SQL skills for data querying, transformation, validation, and troubleshooting.

• Experience with Google Cloud Data Fusion.

• Experience interacting with relational databases such as SQL Server, DB2, or Oracle.

• Skilled in consuming and integrating RESTful APIs and SOAP web services.

• Familiarity with additional Google Cloud services, databases, and enterprise integrations.

• Experience using Jira and Confluence for project management and documentation.

• Previous experience in the retail industry.

• Must reside in Colombia and work Eastern Time (ET) hours.

🏝️ Benefits

• All mandatory Colombian employment benefits and statutory entitlements in compliance with applicable labor legislation.

• A fully remote working arrangement, aligned to Eastern Time working hours.

• Opportunities for professional growth, collaboration, and continuous learning.

• A stimulating environment that encourages you to challenge yourself and explore new horizons.

• A robust culture of innovation and entrepreneurship.

• Opportunities to engage in enterprise-scale data engineering projects using modern cloud technologies.