Senior Data Engineer – Data & AI

This is a fully remote position, open to applicants in Canada.

📋 Description

• Spearhead the design and development of comprehensive data platforms encompassing ingestion, cleaning, preparation, transformation, analytics, and activation.

• Architect Medallion lakehouse patterns utilizing OneLake/Delta Lake.

• Take ownership of dimensional, normalized, and semantic data modeling for client projects.

• Develop batch and streaming ingestion strategies using Fabric Data Factory, Azure Databricks Structured Streaming, and Event Hubs.

• Identify architectural risks and technical debt while optimizing pipelines for enhanced performance and cost efficiency.

• Create APIs and data services for controlled data activation.

• Design MCP and API-based integrations with front-line systems, Fabric/Copilot Data Agents, and agentic AI interfaces.

• Collaborate with AI and Architecture teams to expose enterprise data to Data Agents and Generative AI applications.

• Implement data governance measures using Microsoft Purview and/or Unity Catalog.

• Provide support for production operations and incident response concerning critical pipelines and activation services.

• Mentor Data Engineers and offer technical guidance through code, data model, and design reviews.

• Serve as a trusted technical resource to client stakeholders.

• Contribute to the development of reusable frameworks, accelerators, and engineering standards.

• Assist in presales activities, including estimates, proposals, and solution design.

• Assess Fabric and Azure Databricks capabilities and recommend their implementation.

⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, Statistics, or a related technical field.

• 5-8 years of experience in data engineering, demonstrating strong ownership of production data pipelines on Azure.

• Expertise in Python, SQL, and PySpark at an expert level.

• Extensive hands-on experience with Azure Data Factory, Microsoft Fabric, Synapse, ADLS Gen2, and/or Azure Databricks.

• Familiarity with Delta Lake/OneLake and Medallion architecture patterns.

• Strong foundation in data modeling, schema design, and enterprise data architecture.

• Experience in designing APIs and MCP-based integrations.

• Proficiency in orchestration and CI/CD, including Fabric pipelines, Azure Data Factory, Databricks Workflows, and Azure DevOps.

• Solid understanding of Microsoft Purview and/or Unity Catalog.

• Capability to mentor engineers and lead technical design discussions on client-facing projects.

• Ability to independently troubleshoot complex, large-scale data issues.

• Excellent communication skills for articulating technical trade-offs to both technical and client audiences.

• Relevant Microsoft and/or Databricks certifications are preferred.

🏝️ Benefits

• Great Place To Work 2024-2025 certified employer.

• Commitment to equal opportunity and fostering a diverse, inclusive workforce.