Data Engineer – GCP, Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create and sustain scalable, effective data pipelines (ETL/ELT)

• Manage data ingestion, transformation, and delivery within GCP environments

• Develop solutions utilizing Databricks (Spark/PySpark)

• Design and enhance data architectures (Data Lake, Data Warehouse, Lakehouse)

• Integrate a variety of data sources (APIs, databases, streaming)

• Ensure data quality, governance, and reliability

• Monitor performance metrics and optimize cloud expenditures

• Collaborate with Business Intelligence, Analytics, and Data Science teams

⛳️ Requirements

• Minimum of 4 years of experience in a Data Engineering role

• Practical experience with Google Cloud Platform (BigQuery, Cloud Storage, Dataflow, or comparable services)

• Proficient in Databricks and distributed processing via Spark

• Strong skills in Python and SQL

• Experience in data modeling (both relational and dimensional)

• Familiar with orchestrating pipelines (Airflow or similar tools)

• Knowledge of version control systems (Git)

• Experience with Delta Lake

• Understanding of Infrastructure as Code (Terraform)

• Familiarity with Docker

• Knowledge of data streaming technologies (Kafka, Pub/Sub)

• Possession of GCP or Databricks certifications

• Experience with Lakehouse architecture

• Knowledge of BI tools (Power BI, Looker, Tableau)

• Understanding of data governance and Brazil’s General Data Protection Law (LGPD)

• Intermediate or advanced proficiency in English

🏝️ Benefits

• Continuous professional development opportunities

• Fully remote work arrangement

• Commitment to inclusion for individuals with disabilities (this position is also open to candidates with disabilities)