Data Engineer, Databricks, Fabric

This is a fully remote position, open to applicants in Latin America.

📋 Description

• Develop and manage production data platforms for clients.

• Create and implement ETL/ELT pipelines utilizing Databricks and Microsoft Fabric.

• Establish lakehouses employing Medallion architecture (Bronze, Silver, Gold) on Delta Lake.

• Administer data governance with Unity Catalog, covering permissions, lineage, and quality assurance.

• Streamline deployments through CI/CD and infrastructure as code methodologies.

• Collaborate with clients and other teams to gather requirements.

• Identify potential enhancements in client platforms that could evolve into new projects.

⛳️ Requirements

• Practical experience with Databricks in a production environment.

• Proficiency in PySpark, Delta Lake, Workflows, and Unity Catalog (including catalogs, permissions, and lineage).

• Familiarity with Medallion architecture.

• Production experience with Microsoft Fabric across the entire platform.

• Knowledge of Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2, and Warehouse.

• Strong skills in SQL and Python.

• Valid DP-900 or DP-700 certification, with a commitment to obtain the other within the first 60 days.

• Proficient in English at a B2 level or above and fluent in Spanish.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Opportunities for professional development and training.

• Flexible working hours and remote work options.

• Comprehensive health and wellness benefits.