Mid-Level Data Engineer – Microsoft Azure

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Design and implement data pipelines

• Execute data ingestion and transformation processes

• Prepare and model datasets

• Ensure information accessibility

• Create data solutions utilizing Microsoft Azure, specifically emphasizing Azure Databricks

• Engage in the complete data lifecycle: ingestion, transformation, modeling, and information delivery

• Build scalable solutions with a focus on optimizing performance

⛳️ Requirements

• 2–5 years of experience in Data Engineering

• Extensive knowledge of Microsoft Azure

• Proficient in Azure Databricks

• Familiarity with PySpark and notebooks

• Proven experience in developing ETL/ELT processes

• Experience with Azure Data Lake Storage (ADLS)

• Understanding of Parquet format

• Knowledge of Delta Lake

• Comprehensive experience across the entire data lifecycle: ingestion, transformation, modeling, and information delivery

• Capability to create scalable, performance-oriented solutions

• Background in Scrum/Agile methodologies

• Familiarity with Azure Data Factory

• Experience transitioning from Scala to PySpark

• Understanding of Azure Synapse

• Knowledge of JIRA

• Familiarity with Confluence

🏝️ Benefits

• Competitive salary and performance bonuses

• Opportunities for professional development and training

• Flexible working hours and remote work options

• Comprehensive health and wellness programs

• Collaborative and innovative work environment