Engenheiro de Dados, Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Development and maintenance of data ingestion pipelines

• Implementation of batch/full and incremental loads

• Integration of data from legacy systems and SAP Datasphere

• Development of loading processes in the Raw/Bronze layer of Databricks

• Support for the maintenance, monitoring, and evolution of the area's demands

• Involvement in integration, technical processing, and data availability

• Construction and maintenance of pipelines using PySpark and SQL

• Assurance of traceability, governance, and technical quality of the loads

⛳️ Requirements

• Experience in data engineering

• Proficiency with Databricks

• Experience with PySpark and Spark SQL

• Familiarity with ETL/ELT pipelines and data ingestion

• Knowledge of incremental loads and data integrations

• Understanding of Delta Lake

• Experience with Git/version control

• Ability to work autonomously and handle ongoing team demands

🏝️ Benefits

• Collaborative environment

• Opportunity for learning and growth