Senior Fabric Data Engineer

This is a fully remote position, open to applicants in Canada.

📋 Description

• Design and develop robust data solutions utilizing Microsoft Fabric, which includes OneLake, Fabric Pipelines, Lakehouse, Warehouse, and Notebooks.

• Construct and enhance scalable ingestion and transformation pipelines using PySpark, Python, and SQL for both structured and unstructured datasets.

• Migrate and standardize data from legacy source systems such as Saba, Cura, and other associated enterprise platforms.

• Create API-driven and scheduled workflows to ingest data from internal and external systems to facilitate downstream processing.

• Implement business rules concerning learning history, completion status, certifications, compliance, skills, and learner profile data.

• Develop curated and consumption-ready datasets/models for analytics, dashboards, and operational reporting purposes.

• Conduct SQL development and optimization for reporting, analytics, and downstream consumption needs.

• Establish automated data quality checks, reconciliations, monitoring, exception handling, and audit logging.

• Enforce secure access controls utilizing Azure AD, RBAC, managed identities, and secure connectivity patterns.

• Provide support for CI/CD, code promotion, release management, and operational monitoring within an Agile delivery framework.

⛳️ Requirements

• Over 7 years of experience in data engineering and enterprise data integration.

• Significant hands-on experience with Microsoft Fabric and related Azure data services.

• Strong expertise in PySpark, SparkSQL, Python, and SQL/T-SQL.

• Proven experience in building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms.

• Familiarity with curated data layers, data modeling, and analytics-ready datasets.

• Experience in tuning data pipelines for scale, resilience, and cost efficiency.

• Working knowledge of security, access controls, and data governance practices.

• Proficiency with Azure DevOps and Git-based deployment automation.

• Strong analytical, troubleshooting, and communication abilities.

• Experience in learning, HR, or talent data domains.

• Familiarity with ADF, Synapse, Databricks, Azure Functions, or Logic Apps.

• Exposure to AI tools such as GitHub Copilot and Claude.

• Experience with data governance tools like Purview.

• Exposure to AI/ML-ready data preparation and feature engineering practices.

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.

• Ability to work independently and take initiative in a fast-paced delivery environment.

• Comfortable working in remote or hybrid teams while coordinating cross-functionally.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and the option for remote work.

• Opportunities for professional development and career advancement.

• A collaborative and innovative work culture.