Data Engineer, GCP, Databricks, Mid-level

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create and sustain scalable, efficient data pipelines (ETL/ELT);

• Engage in data ingestion, transformation, and provisioning within GCP environments;

• Develop solutions utilizing Databricks (Spark/PySpark);

• Design and enhance data architectures (Data Lake, Data Warehouse, Lakehouse);

• Integrate various data sources (APIs, databases, streaming);

• Ensure the quality, governance, and reliability of data;

• Monitor performance and optimize costs in the cloud;

• Collaborate with Business Intelligence, Analytics, and Data Science teams.

⛳️ Requirements

• At least 4 years of experience working as a Data Engineer;

• Practical experience with Google Cloud Platform (BigQuery, Cloud Storage, Dataflow or similar);

• Familiarity with Databricks and distributed processing using Spark;

• Strong proficiency in Python and SQL;

• Experience in data modeling (both relational and dimensional);

• Knowledge of pipeline orchestration tools (Airflow or similar);

• Understanding of version control systems (Git);

• Experience with Delta Lake (preferred);

• Knowledge of infrastructure as code practices (Terraform) (preferred);

• Experience with Docker (preferred);

• Familiarity with data streaming technologies (Kafka, Pub/Sub) (preferred);

• GCP or Databricks certifications (preferred);

• Experience with Lakehouse architecture (advantage);

• Knowledge of Business Intelligence tools (Power BI, Looker, Tableau) (advantage);

• Understanding of data governance and LGPD (Brazilian General Data Protection Law) (advantage);

• Intermediate to advanced proficiency in English (a plus).

🏝️ Benefits

• Fully remote work opportunity.