Junior Data Engineer – Microsoft Azure, Databricks

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Design and implement data solutions within a Microsoft Azure environment, adhering to best practices in Data Engineering;

• Create and manage ETL/ELT pipelines utilizing Azure Data Factory and Azure Databricks, including the creation of PySpark notebooks;

• Engage in the complete data solution development lifecycle, from data ingestion and transformation to data modeling and accessibility;

• Assist in the development of data models based on Data Lakehouse architectures, specifically through the Medallion Architecture approach;

• Work collaboratively with the technical team on the analysis, creation, testing, and deployment of Data Engineering solutions;

• Aid in the monitoring, maintenance, and enhancement of data pipelines and processes.

⛳️ Requirements

• 6 months to 1 year of experience in Data Engineering;

• Familiarity with the Microsoft Azure ecosystem;

• Practical experience with Azure Databricks;

• Proficient in PySpark and notebook development within Databricks;

• Experience in developing ETL/ELT pipelines;

• Understanding of the complete data solution development lifecycle, including transformation, modeling, and data accessibility;

• Knowledge of Data Lakehouse architectures and the Medallion Architecture;

• Experience with Azure Data Factory;

• Familiarity with Agile/Scrum methodologies;

• Knowledge of Jira and Confluence;

• Understanding of data modeling;

• Awareness of best practices for the quality, organization, and documentation of data pipelines.

🏝️ Benefits

• Competitive salary package;

• Opportunities for professional growth and development;

• Collaborative work environment with a focus on innovation;

• Access to state-of-the-art tools and technologies.