Senior Data Engineer – Databricks, Azure

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and sustain the analytical consumption and monitoring layer of the platform.

• Set up and oversee query environments utilizing Databricks SQL Warehouse.

• Maintain a distinct separation between processing and analytical consumption layers.

• Provide governed datasets for Power BI and various corporate applications.

• Work on the integration of Databricks, Power BI, and Azure Data Lake Storage (ADLS).

• Manage historical storage and data persistence using Delta Lake.

• Ensure data traceability, auditing, and the capability to reprocess data.

• Design strategies for RAW, curated, and historical storage within the Lakehouse.

• Implement practices for data monitoring, governance, and observability.

• Assist business and analytics teams in developing executive dashboards and strategic KPIs.

⛳️ Requirements

• Proven experience with Databricks SQL Warehouse.

• Understanding of Lakehouse architecture.

• Experience with Azure Data Lake Storage (ADLS).

• Familiarity with Delta Lake and Delta tables.

• Proficient in Power BI and analytical modeling.

• Advanced skills in SQL.

• Experience with ETL/ELT pipelines.

• Background in data governance, quality, and monitoring.

• Familiarity with Azure cloud environments.

• Preferred / Nice-to-have:

• Experience with Unity Catalog (Databricks).

• Knowledge of DataOps / MLOps.

• Experience with orchestration tools (e.g., Azure Data Factory).

• Understanding of data security and access control (RBAC/ABAC).

🏝️ Benefits

• Experience with Databricks SQL Warehouse.

• Knowledge of Lakehouse architecture.

• Experience with Azure Data Lake Storage (ADLS).

• Knowledge of Delta Lake and Delta tables.

• Experience with Power BI and analytical modeling.

• Advanced SQL proficiency.

• Experience with ETL/ELT pipelines.

• Experience in data governance, quality, and monitoring.

• Experience with Azure cloud environments.

• Preferred / Nice-to-have:

• Experience with Unity Catalog (Databricks).

• Knowledge of DataOps / MLOps.

• Experience with orchestration tools (e.g., Azure Data Factory).

• Familiarity with data security and access control (RBAC/ABAC).