Data Engineer – GCP

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and maintain batch and streaming data pipelines within a GCP environment.

• Convert business requirements into effective technical data solutions.

• Create pipelines utilizing Dataflow, Dataform, Pub/Sub, Cloud Storage, and BigQuery.

• Manage pipeline orchestration with Cloud Composer/Airflow.

• Conduct data modeling, testing, governance, security, and observability.

• Take ownership of the complete delivery lifecycle, from development to deployment and documentation of solutions.

• Engage with technical and business teams, including those located internationally.

⛳️ Requirements

• Proficient in English for effective communication with teams outside Brazil.

• Availability to work during EST (Eastern Standard Time) hours.

• Proven experience in Data Engineering with GCP in production settings.

• Familiarity with Dataflow, Dataform, Pub/Sub, Cloud Storage, and BigQuery.

• Advanced understanding of BigQuery, including partitioning, clustering, performance, and cost optimization.

• Experience using Cloud Composer/Airflow for orchestrating pipelines.

• Knowledge of data modeling, Data Warehousing, Star Schema, Snowflake Schema, SCD, and Medallion Architecture.

• Proficient in Python, Git, Code Review, Docker, and CI/CD, preferably with Cloud Build.

• Understanding of data governance, security, and observability on GCP, including Dataplex, IAM, and PII protection.

• Experience with automated testing, preferably using pytest, and data quality methodologies.

• Google Professional Data Engineer certification is a plus.

• Familiarity with BigLake, Apache Iceberg, and Data Lakehouse architectures is a plus.

• Experience with Data Mesh and Data Products is a plus.

• Knowledge of SAP ECC, BW, or S/4HANA is a plus.

• Understanding of Data Contracts, Schema Evolution, and observability is a plus.

• Experience with GenAI and Vertex AI is a plus.

• Experience with Knowledge Transfer (KT) and technical training is a plus.

• Strong communication skills for engaging with both technical and non-technical audiences.

• Capability to translate business needs into technical solutions.

• Collaborative mindset for effective teamwork across various departments and teams.

• Excellent organizational skills for documentation, delivery tracking, and deployment.

• Ability to thrive in an international environment, using English daily.

🏝️ Benefits

• Learning incentive programs (Udemy).

• Affordable corporate English classes.