Data Engineer, GCP

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Collect and articulate requirements for custom data connectors that are not addressed by the current prebuilt connector library.

• Work alongside Business Analysts, Discovery teams, and Data Architects to pinpoint data sources that necessitate custom connector development.

• Design, create, and evaluate custom connectors utilizing both sample and synthetic datasets.

• Develop scalable data integration solutions leveraging Google Cloud Platform services such as Dataflow, Cloud Functions, and Cloud Run.

• Implement error handling mechanisms, retry strategies, and dead-letter queue processes.

• Assess connector performance, functionality, and adherence to both technical and business specifications.

• Facilitate data ingestion, transformation, and integration across manufacturing and operational systems.

• Document the architecture, behavior, configurations, and operational procedures of connectors.

• Oversee the transition and handoff of custom connector deployments to the Lead Data Engineer.

• Engage in data governance and data quality initiatives.

• Contribute to enterprise data modernization initiatives within secure and regulated environments.

⛳️ Requirements

• Proficiency with Google Cloud Platform (GCP).

• In-depth understanding of Big Data solutions within Google Cloud Platform.

• Familiarity with Google Cloud database technologies.

• Experience in developing custom data integration connectors and ingestion pipelines.

• Knowledge of Dataflow, Cloud Functions, and Cloud Run.

• Background in Data Analysis and Data Modeling.

• Experience with Data Management and Data Analysis methodologies.

• Understanding of Data Governance principles.

• Knowledge of Data Integration and ETL processes.

• Ability to gather, analyze, and document both business and technical requirements.

• Experience working with various data sources and integration patterns.

• Strong comprehension of scalable cloud-based data architectures.

• Capability to document technical solutions and assist in knowledge transfer activities.

• Experience in Agile project environments.

• Background in supporting manufacturing modernization efforts.

• Experience in regulated or compliance-focused environments.

• Familiarity with FedRAMP High, IL4, or comparable cloud security frameworks.

• Experience with AI-enabled data platforms or analytics solutions.

• Understanding of Looker analytics and reporting solutions.

• Experience in supporting enterprise-scale cloud migration and data modernization projects.

• Knowledge of workforce enablement platforms and operational analytics.

🏝️ Benefits

• Flexible working hours.

• Remote work options.

• Multi-disciplinary teams and collaboration opportunities.

• Diverse global team.

• Personalized career development plan.

• Training programs.

• High-impact projects with leading industry clients.