Senior Data Engineer, Microsoft Fabric

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Design, develop, and maintain enterprise data solutions utilizing Microsoft Fabric.

• Create scalable data ingestion pipelines from various sources such as APIs, databases, and file-based systems.

• Construct and uphold Lakehouse architectures using the Medallion approach (Bronze, Silver, and Gold).

• Design robust data models and semantic layers to facilitate business reporting.

• Develop and maintain Power BI semantic models and dashboards.

• Implement frameworks for data quality, validation, and reconciliation.

• Design secure and governed data solutions, incorporating Row-Level Security and access controls.

• Create and manage PySpark notebooks for data transformation purposes.

• Develop ETL/ELT processes using SQL and Python.

• Configure and oversee Fabric workspaces, OneLake environments, and deployment pipelines.

• Collaborate closely with solution architects to execute scalable platform designs.

• Generate technical documentation and engineering standards.

• Work in partnership with UK-based stakeholders and delivery teams.

• Assist with future client projects within the TXP Data & AI Practice.

⛳️ Requirements

• Extensive commercial experience with Microsoft Fabric.

• Familiarity with Fabric Data Factory, Dataflows Gen2, Lakehouse, and OneLake.

• Proficient SQL skills.

• Strong experience with Python and/or PySpark.

• Proven experience in designing enterprise data models.

• Deep understanding of Medallion Architecture.

• Experience in developing scalable ETL/ELT pipelines.

• Knowledge of REST API integration.

• Familiarity with implementing data quality and reconciliation processes.

• Solid experience with Power BI, including semantic modeling and DAX.

• Understanding of Azure fundamentals, particularly Entra ID and Key Vault.

• Proven ability to work independently on complex technical projects.

• Excellent communication skills in English.

🏝️ Benefits

• Join our collaborative environment where responsibilities and authority are shared equally among colleagues, contributing to our company culture.

• A culture that encourages learning from mistakes rather than criticizing failure.

• An Agile environment where your ideas are valued and welcomed.

• Opportunities for growth and involvement in diverse projects.

• Continuous training and mentoring.

• Opportunities for travel.