Ingeniero de Datos Azure – Databricks

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Design, build, and optimize data architectures utilizing Azure and Databricks.

• Implement ETL and ELT processes to integrate various information sources.

• Design and manage Data Lake and Lakehouse architectures.

• Monitor data pipelines to ensure consistency, quality, traceability, and security.

• Prepare and optimize datasets for advanced analytics, reporting, and Machine Learning models.

• Collaborate with BI, analytics, and data science teams to facilitate information access.

• Define and implement data governance and quality controls.

• Implement continuous integration and continuous deployment processes for data solutions.

• Design scalable solutions for distributed processing and large data volumes.

• Identify improvement opportunities to optimize costs, performance, and processing times.

• Evaluate new technologies and best practices for the evolution of the data platform.

⛳️ Requirements

• Degree in Systems Engineering, Industrial Engineering, Electronic Engineering, Mechatronics Engineering, or related fields.

• 3 to 5 years of experience as a Data Engineer.

• Advanced proficiency in SQL.

• Experience with Python or Scala.

• Experience in distributed processing with PySpark.

• Experience with Azure Databricks.

• Experience with Azure Data Factory.

• Experience with Azure Data Lake Storage Gen2 (ADLS Gen2).

• Knowledge of Delta Lake.

• Experience in Lakehouse architectures.

• Familiarity with Medallion architecture.

• Experience in dimensional modeling.

• Experience with relational databases.

• Experience with NoSQL databases.

• Knowledge of data governance and quality.

• Experience with Unity Catalog.

• Experience with Delta Live Tables (DLT).

• Knowledge of Great Expectations.

• Experience in streaming processing using Event Hubs.

• Experience with Azure DevOps and Git.

• Familiarity with Entra ID.

• Understanding of RBAC.

• Proficient in Power BI.

• Proficient in Visual Studio Code.

• Experience in data integration and ETL/ELT processes.

• Experience in data analysis and modeling.

• Azure certifications related to Data Engineering are a plus.

• Experience in Artificial Intelligence and Machine Learning projects is a plus.

• Knowledge of DataOps and data platform automation is a plus.

🏝️ Benefits

• Flexible working hours.

• Remote work opportunities.

• Personalized career development plans.

• Training programs.

• Work within multidisciplinary teams.

• Diverse global team.

• High-impact projects with leading industry clients.