Azure Data Lead

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of the comprehensive design for the client's desired Microsoft Fabric architecture, covering workspace organization, capacity planning, and cost forecasting.

• Spearhead the technical strategy for transitioning the current Azure Synapse platform to Microsoft Fabric, focusing on migration methods, data transfer patterns, and sequencing.

• Assess and recommend between OneLake shortcuts and one-time data copies while ensuring minimal disruption to ongoing initiatives.

• Design secure networking for Microsoft Fabric, incorporating private endpoints and virtual network integration, in collaboration with infrastructure and security teams.

• Architect near-real-time data ingestion processes from Oracle ERP and various on-premises and Azure SQL Server databases.

• Develop and implement ingestion patterns utilizing SQL Server mirroring and Oracle Change Data Capture.

• Establish data sensitivity classification and tagging methodologies at the schema, table, and column levels.

• Create a roadmap that transitions from an ingestion-and-protection-first approach to a full Medallion architecture and downstream dimensional modeling.

• Act as the primary technical liaison for inquiries related to Microsoft Fabric capabilities and architecture.

• Collaborate directly with Microsoft's product team to verify Microsoft Fabric capabilities, availability, and limitations in GCC High environments.

• Convert technical insights into client-facing documentation, architecture recommendations, and change request inputs.

• Provide daily technical guidance and mentorship to Data Engineers assigned to the account.

• Review technical designs and code, address complex technical issues, and assist in unblocking engineering teams.

• Work with account and delivery leadership to define scope, staffing requirements, and the technical roadmap as the engagement progresses.

⛳️ Requirements

• U.S. Citizen residing within the United States.

• Over 7 years of professional experience in data engineering.

• At least 3 years in a Lead, Architect, or similar senior technical ownership role.

• Practical experience in implementing Microsoft Fabric, including OneLake, Lakehouse, Data Factory pipelines, and workspace/capacity management.

• Experience in either production or pilot implementations of Microsoft Fabric in an enterprise setting.

• In-depth understanding of the Azure Data & AI ecosystem, including Azure Synapse Analytics, Azure Data Factory, Azure SQL/SQL Server, Azure Data Lake Storage, and Azure OpenAI or Azure AI services.

• Proven experience leading data platform migrations, such as from Synapse to Fabric or similar data platform modernization efforts.

• Expertise in designing secure Azure networking for data platforms, encompassing private endpoints and VNet integration.

• Strong SQL and Python/PySpark proficiency with a track record of delivering production-grade data pipelines.

• Familiarity with Change Data Capture (CDC), database mirroring, or replication techniques for near-real-time data ingestion.

• Experience with SQL Server, Oracle, or comparable enterprise database systems.

• Understanding of Medallion architecture and dimensional modeling, including facts, dimensions, and star schemas.

• Previous experience delivering solutions in regulated or compliance-sensitive environments such as CMMC, DFARS, FedRAMP, or similar frameworks.

• Excellent client-facing communication skills, with the ability to lead technical workshops and articulate architecture decisions to non-technical stakeholders.

• Experience mentoring engineers and providing technical guidance across a data engineering team.

• Nice to have: Direct experience with Microsoft Fabric in GCC High environments.

• Nice to have: Experience working with government or defense-industrial clients.

• Nice to have: Familiarity with CMMC, DFARS, FedRAMP, or equivalent compliance frameworks.

• Nice to have: Experience collaborating directly with Microsoft product teams on cloud platform capabilities and feature availability.

• Nice to have: Experience formulating architecture roadmaps for evolving data platforms.

• Nice to have: Knowledge in enterprise cloud cost forecasting and capacity optimization.

• Nice to have: Experience with Azure OpenAI and other Azure AI services.

🏝️ Benefits

• Potential for a 6-month extension.

• Fully remote work arrangement.