Senior Data Engineer – Microsoft Azure

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Collaborate closely with both business and technical teams.

• Collect and analyze requirements.

• Convert requirements into technical specifications.

• Create data solutions.

• Build data pipelines.

• Enhance transformation processes.

• Assist in defining architecture and standards.

• Maintain data quality, security, and governance.

• Offer technical assistance and mentorship to junior team members.

⛳️ Requirements

• Over 5 years of experience in Data Engineering.

• Proficient experience with Microsoft Azure.

• In-depth experience with Azure Databricks.

• Familiarity with PySpark.

• Knowledge of Azure Data Factory.

• Proven experience in developing and optimizing ETL/ELT processes.

• Experience with Azure Data Lake Storage / ADLS.

• Proficient with Parquet.

• Knowledge of Delta Lake.

• Comprehensive experience in data ingestion, transformation, modeling, and delivery.

• Ability to design scalable, performance-focused architectures.

• Familiarity with DataHub / data platforms.

• Capability to translate functional requirements into technical solutions.

• Experience working in Agile / SCRUM environments.

• Scala-to-PySpark migration experience.

• Knowledge of Azure Synapse.

• Familiarity with JIRA.

• Experience with Confluence.

• Proven technical leadership experience.

• Experience in data architecture.

🏝️ Benefits

• Remote work opportunities.

• Permanent employment status.

• Chance to work for a global provider of engineering, technology, and consulting services.

• Exposure to projects and teams across a global footprint covering 30 countries.