Senior Data Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, develop, and sustain scalable data pipelines and ETL/ELT processes utilizing Azure Data Factory and Azure Databricks.

• Create effective data processing and transformation solutions using Python and Databricks.

• Manage large and intricate datasets, ensuring data quality, reliability, and performance.

• Contribute to the design and execution of modern data architectures within the Azure ecosystem.

• Apply Medallion Architecture principles to construct robust and scalable data solutions.

• Assist in the development of Data Vault and Business Vault architectures using Databricks on Azure.

• Engage with Microsoft Fabric and OneLake, including shortcuts for integrating and accessing data across diverse platforms.

• Participate in data modeling activities within Azure Data Warehouse and related analytical environments.

• Collaborate with Data Architects, Developers, Analysts, and other stakeholders to comprehend requirements and translate them into efficient technical solutions.

• Identify opportunities for enhancing data processing, architecture, performance, and automation.

• Ensure that solutions adhere to best practices regarding scalability, security, maintainability, and data governance.

⛳️ Requirements

• Demonstrated professional experience as a Data Engineer.

• Strong practical experience with Azure Data Factory (ADF).

• Extensive experience with Azure Databricks.

• Proficient programming skills in Python.

• Comprehensive understanding of data engineering principles, encompassing ETL/ELT, data transformation, and data modeling.

• Experience with cloud-based data platforms and large-scale data processing.

• Solid understanding of SQL and relational data concepts.

• Familiarity with Medallion Architecture.

• Knowledge of Data Vault and Business Vault methodologies.

• Experience in implementing Data Vault solutions using Databricks on Azure.

• Experience with Microsoft Fabric and OneLake, particularly OneLake shortcuts.

• Knowledge of data modeling in Azure Data Warehouse.

• Experience in the financial services or wealth management sector.

• Understanding of data governance, data quality, and modern cloud data architecture principles.

🏝️ Benefits

• Remote work opportunity within Spain.

• Chance to be part of a multicultural team.

• Involvement in international projects.

• CET working hours.