Engenheiro de Dados – Senior

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Analyze and migrate pipelines and notebooks (Spark/Databricks)

• Refactor or rewrite processes for: SQL / Dataform and Dataflow

• Create transformations in BigQuery + Dataform

• Build layers: Silver (Trusted) and Gold

• Ensure quality, deduplication, and standardization

• Implement ingestion using: Dataflow (Apache Beam) for events (Kafka/Event Hubs) and Datastream (CDC)

• Work with data persistence in the Raw layer using Iceberg tables managed by BigLake.

• Provision resources with Terraform (IaC)

• Manage pipelines with CI/CD (GitHub Actions)

• Follow the Ingestion Factory model and repositories by domain

• Implement tests in Dataform

• Ensure:

• Cataloging and lineage (Dataplex)

• Secure sharing (Analytics Hub)

⛳️ Requirements

• Advanced SQL (preferably BigQuery)

• Experience with GCP: BigQuery, GCS, Dataflow, Cloud Composer (Airflow)

• Python + Apache Spark

• Knowledge in:

• Data Lakehouse

• Data modeling

• Partitioning

• Formats (Parquet, Avro, Iceberg)

• Experience with: Git and CI/CD

• Differentials:

• Dataform or DBT

• Experience with Databricks

• Terraform (IaC)

• Streaming and events (Kafka / Event Hubs)

• Governance and security: Dataplex, IAM, VPC Service Controls

🏝️ Benefits

• Health and dental insurance;

• Meal and food vouchers;

• Childcare assistance;

• Extended parental leave;

• Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) and TotalPass;

• Profit Sharing and Results (PLR);

• Life insurance;

• Continuous learning platform (CI&T University);

• Discount club;

• Free online platform dedicated to promoting physical, mental health, and well-being;

• Courses on pregnancy and responsible parenthood;

• Partnerships with online course platforms;

• Language learning platform;

• And many more