Mid-Level GCP Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create and sustain scalable, high-performance data pipelines (ETL/ELT)

• Manage data ingestion, transformation, and delivery within GCP environments

• Develop solutions utilizing Databricks (Spark/PySpark)

• Design and enhance data architectures (Data Lake, Data Warehouse, Lakehouse)

• Integrate various data sources (APIs, databases, streaming)

• Ensure the quality, governance, and reliability of data

• Monitor performance and optimize expenses in the cloud

• Collaborate with Business Intelligence, Analytics, and Data Science teams

⛳️ Requirements

• Minimum of 4 years of experience as a Data Engineer

• Practical experience with Google Cloud Platform (BigQuery, Cloud Storage, Dataflow, or similar services)

• Familiarity with Databricks and distributed processing using Spark

• Proficient in Python and SQL

• Experience in data modeling (both relational and dimensional)

• Background in orchestrating pipelines (Airflow or comparable tools)

• Understanding of code version control systems (Git)

• Proficient with Delta Lake

• Familiarity with infrastructure as code (Terraform)

• Experience with Docker

• Knowledge of data streaming technologies (Kafka, Pub/Sub)

• Possession of GCP or Databricks certifications

• Experience with Lakehouse architecture

• Familiarity with BI tools (Power BI, Looker, Tableau)

• Understanding of data governance and Brazil's General Data Protection Law (LGPD)

• Intermediate or advanced proficiency in English

🏝️ Benefits

• Continuous professional growth opportunities

• Fully remote work environment

• Position is also available for individuals with disabilities