Senior Data Engineer

This is a fully remote position, open to applicants in Europe.

📋 Description

• Design, construct, and manage pipelines to ingest and transfer data from various sources (on-prem databases, APIs, flat files, line-of-business systems) into Microsoft Fabric.

• Implement and sustain Fabric medallion architecture (Bronze/Silver/Gold layers), ensuring transformation logic is structured for data quality and consistency.

• Write Python (e.g., PySpark, notebooks) and SQL for data transformation, cleansing, and modeling within Fabric Lakehouses and Warehouses.

• Create and orchestrate pipelines using Azure Data Factory and/or Fabric Data Factory.

• Develop and maintain Power Apps (canvas and model-driven) for operational engineering applications.

• Construct Power Automate flows that integrate with Azure services and Fabric data.

• Generate Power BI reports and dashboards utilizing curated Fabric (Gold layer) data.

• Maintain and enhance Dataverse tables, relationships, and security models.

• Contribute to strengthening CI/CD pipelines for both Power Platform solutions and Fabric/data engineering code through Azure DevOps.

• Assist in establishing and documenting development standards, naming conventions, and code review practices.

• Support governance initiatives including environment strategy, DLP policies, and Fabric workspace/capacity management.

• Collaborate with engineering stakeholders to comprehend requirements for data, automation, and reporting needs.

• Provide ongoing support and troubleshooting for existing pipelines, flows, and applications.

⛳️ Requirements

• Hands-on development experience across Power Apps, Power Automate, and Power BI.

• Strong working proficiency in Python and SQL for data transformation and pipeline development.

• Practical experience with Microsoft Fabric, including medallion architecture (Bronze/Silver/Gold), Lakehouses, and Dataflows Gen2.

• Experience with Azure Data Factory (or Fabric Data Factory) for orchestrating data ingestion and transformation pipelines.

• Experience in migrating or ingesting data from various sources (databases, APIs, files, legacy systems) to a modern data platform.

• Solid understanding of Dataverse, encompassing table design, security roles, and relationships.

• Experience in an engineering, manufacturing, or industrial sector.

• Comfortable collaborating as part of a small team, sharing knowledge, and reviewing peers' work.

• Familiarity with Azure DevOps for source control and release management.

• Nice to have: Microsoft certifications (e.g., PL-400, PL-300, DP-600, or DP-700).

• Nice to have: Experience with PySpark notebooks in Microsoft Fabric.

• Nice to have: Knowledge of CI/CD pipelines for Power Platform and data engineering solutions.

• Nice to have: Exposure to Copilot Studio or AI Builder.

• Nice to have: Experience with engineering, manufacturing, or industrial data.

• Nice to have: Understanding of IoT or sensor data integration.

🏝️ Benefits

• 100% Remote Work

• WFH allowance: Monthly payment as financial support for remote working.

• Career Growth: We have established a career development program accessible to all employees with 360º feedback to guide you in your career progression.

• Training: For tech training at Zartis, time is allocated during the week for your use. You can request from a variety of options such as online courses (from Pluralsight and Educative.io, for example), English classes, books, conferences, and events.

• Mentoring Program: You can become a mentor at Zartis or receive mentorship, or both.

• Zartis Wellbeing Hub (Kara Connect): A platform providing sessions with various specialists, including mental health professionals, nutritionists, physiotherapists, fitness coaches, and webinars with such professionals.

• Multicultural working environment: We organize tech events, webinars, parties, and activities for online team-building games and contests.