Engenheiro de Dados – Azure Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop, maintain, and optimize data pipelines in an Azure Databricks environment.

• Work on the ingestion, transformation, processing, and availability of data for analytical or operational consumption.

• Support the modeling and organization of data in Data Lake and Lakehouse-based architectures.

• Create notebooks, jobs, and processing routines using Databricks.

• Integrate various data sources into the Azure environment as per project requirements.

• Collaborate with technical and business teams to understand requirements and translate them into data solutions.

• Promote best practices in performance, governance, versioning, and technical documentation.

⛳️ Requirements

• Hands-on experience with Azure Databricks.

• Knowledge of Apache Spark / PySpark.

• Experience with Python and/or SQL for data manipulation and transformation.

• Familiarity with Azure data-related services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, and Azure DevOps.

• Understanding of Data Lake, Lakehouse, ETL/ELT concepts, and data pipelines.

• Experience with code versioning, preferably using Git.

• Basic knowledge of security, access control, and data governance in a cloud environment.

• Intermediate English proficiency.

• Willingness to travel.

🏝️ Benefits

• Flash card with a food allowance of R$ 32.00 per day.

• Home office assistance of R$ 100.00/month and flexible working hours.

• SulAmérica Health Plan and Bradesco Dental Plan, with the option to include dependents.

• WellHub, TotalPass, and UniCamente for comprehensive health care.

• Onhappy, a platform for corporate and leisure travel with exclusive discounts.

• Guapeco Pet Health Plan for pet care.

• Discounts and Rewards Club, offering discounts on products and services.

• Extended maternity and paternity leave.

• Profit Sharing - according to union table.

• Birthday Day-Off.

• No Dress Code. Dress in whatever makes you comfortable!

• Continuous Education and Training Incentive Program.

• Talent Referral Program.