MS Fabric Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and sustain scalable data pipelines utilizing Microsoft Fabric and Azure Data Services.

• Create and execute Lakehouse and Warehouse data models, medallion architecture, and star-schema semantic models tailored for Direct Lake reporting.

• Construct, manage, and enhance Fabric Notebooks using PySpark, Spark SQL, and/or Python.

• Ingest, cleanse, and transform large-scale data following Spark and Delta Lake performance best practices.

• Partner with data analysts, data scientists, and business stakeholders to comprehend requirements and provide actionable insights.

• Execute data ingestion, transformation, and integration workflows via pipelines, Dataflows Gen2, and notebooks.

• Choose suitable Fabric tools based on complexity, performance, and maintainability.

• Oversee, troubleshoot, and enhance pipelines, notebooks, and data models for availability and precision.

• Ensure adherence to data governance policies and industry regulations.

• Document data models, architectures, processes, and workflows.

• Stay updated with Microsoft Fabric and Azure changes and suggest enhancements.

• Assist in the deployment and upkeep of business intelligence and reporting platforms, including Power BI semantic models.

• Work remotely from the United States within a secure, HIPAA-compliant workspace.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline.

• Over 3 years of experience in data engineering, data architecture, or a comparable role.

• Demonstrated hands-on expertise in building data models and Notebooks within Microsoft Fabric (Lakehouse and/or Warehouse).

• Proven experience writing PySpark/Spark SQL in a notebook setting for data transformation and pipeline development.

• Strong programming capabilities in SQL and at least one additional language such as Python, Scala, or similar.

• Experience in designing and implementing intricate data pipelines and ETL/ELT workflows.

• Familiarity with cloud infrastructure, security best practices, and compliance standards.

• Exceptional analytical and problem-solving skills.

• Strong communication abilities and capacity to collaborate across technical and business teams.

• Expertise in Microsoft Fabric and Azure Data Services, including Lakehouse, Warehouse, OneLake, Delta Lake, medallion architecture, Azure Data Factory/Fabric Pipelines, Dataflows Gen2, Azure Synapse Analytics, and Azure Data Lake.

• Knowledge of data governance, data quality, and compliance standards.

• Capability to work with Power BI and comprehend analytics requirements.

• Microsoft certifications such as Fabric Data Engineer Associate (DP-700), Azure Data Engineer Associate, or Microsoft Certified: Data Analyst Associate are advantageous, though not mandatory.

• Reliable high-speed internet connection and stable Wi-Fi are essential.

• HIPAA-compliant work environment with secure workspace; no public Wi-Fi is permitted unless using a secure company-provided VPN, in compliance with HIPAA regulations.

🏝️ Benefits

• Reliable high-speed internet connection is mandatory for remote/hybrid positions.

• Stable Wi-Fi with adequate bandwidth for video conferencing, cloud-based tools, and online tasks.

• Requirements for a HIPAA-compliant secure workspace.

• Remote work arrangement available.