Senior Data Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, create, and sustain scalable data pipelines and ETL/ELT processes utilizing Azure Data Factory and Azure Databricks.

• Develop effective data processing and transformation solutions with Python and Databricks.

• Handle large and intricate datasets, ensuring data quality, reliability, and efficiency.

• Play a role in the design and execution of modern data architectures within the Azure ecosystem.

• Apply Medallion Architecture principles to construct robust and scalable data solutions.

• Assist in the development of Data Vault and Business Vault architectures utilizing Databricks on Azure.

• Engage with Microsoft Fabric and OneLake, including shortcuts for integrating and accessing data across various platforms.

• Participate in data modeling tasks within Azure Data Warehouse and associated analytical environments.

• Collaborate with Data Architects, Developers, Analysts, and other stakeholders to comprehend requirements and convert them into effective technical solutions.

• Identify opportunities to enhance data processing, architecture, performance, and automation.

• Ensure that solutions adhere to best practices regarding scalability, security, maintainability, and data governance.

⛳️ Requirements

• Demonstrated professional experience as a Data Engineer.

• Significant hands-on experience with Azure Data Factory (ADF).

• Extensive experience with Azure Databricks.

• Proficient programming skills in Python.

• Strong understanding of data engineering principles, including ETL/ELT, data transformation, and data modeling.

• Experience with cloud-based data platforms and large-scale data processing.

• Good knowledge of SQL and relational data concepts.

• Familiarity with Medallion Architecture.

• Understanding of Data Vault / Business Vault methodologies.

• Experience in implementing Data Vault solutions using Databricks on Azure.

• Knowledge of Microsoft Fabric and OneLake, especially OneLake shortcuts.

• Understanding of data modeling in Azure Data Warehouse.

• Experience in the financial services or wealth management sector.

• Familiarity with data governance, data quality, and modern cloud data architecture principles.

🏝️ Benefits

• Remote work opportunity within Spain.

• Chance to be part of a multicultural team and engage in international projects.

• CET working hours.