Senior Data Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, develop, and maintain scalable data pipelines along with ETL/ELT processes utilizing Azure Data Factory and Azure Databricks.

• Create efficient data processing and transformation solutions using Python and Databricks.

• Handle large and complex datasets, ensuring high data quality, reliability, and performance.

• Contribute to the design and implementation of contemporary data architectures within the Azure ecosystem.

• Utilize Medallion Architecture principles to construct robust and scalable data solutions.

• Assist in developing Data Vault and Business Vault architectures leveraging Databricks on Azure.

• Engage with Microsoft Fabric and OneLake, including shortcuts for integrating and accessing data across various platforms.

• Participate in data modeling activities within Azure Data Warehouse and associated analytical environments.

• Collaborate with Data Architects, Developers, Analysts, and other stakeholders to translate requirements into technical solutions.

• Identify opportunities for enhancing data processing, architecture, performance, and automation.

• Ensure that solutions adhere to best practices regarding scalability, security, maintainability, and data governance.

⛳️ Requirements

• Demonstrated professional experience as a Data Engineer.

• Extensive hands-on experience with Azure Data Factory (ADF).

• Strong expertise in Azure Databricks.

• Proficient programming skills in Python.

• Comprehensive understanding of data engineering principles, including ETL/ELT, data transformation, and data modeling.

• Experience working with cloud-based data platforms and large-scale data processing.

• Solid understanding of SQL and relational data concepts.

• Familiarity with Medallion Architecture.

• Knowledge of Data Vault and Business Vault methodologies.

• Experience in implementing Data Vault solutions using Databricks on Azure.

• Proficient with Microsoft Fabric and OneLake, especially OneLake shortcuts.

• Understanding of data modeling in Azure Data Warehouse.

• Experience in the financial services or wealth management sector.

• Knowledge of data governance, data quality, and modern cloud data architecture principles.

• Ability to work remotely within Spain and during CET working hours.

🏝️ Benefits

• Remote work opportunity within Spain.

• Chance to join a multicultural team and engage in international projects.

• CET working hours.