Lead Data Engineer – Azure Fabric

This is a fully remote position, open to applicants in Arizona.

📋 Description

• Collect customer requirements and convert functional needs into technical solutions.

• Simplify intricate technical concepts into actionable insights for stakeholders.

• Engage in architectural discussions to design data engineering solutions that are reliable, secure, scalable, efficient, and cost-effective.

• Develop and implement architectures for the Microsoft Fabric data platform utilizing OneLake, Lakehouse, Fabric Data Factory, Synapse Data Engineering, and Data Warehousing.

• Create scalable pipelines for batch and streaming data ingestion, transformation, and orchestration.

• Design high-performance models for Lakehouse and Warehouse using medallion architecture and dimensional modeling.

• Integrate Azure Data Factory, ADLS Gen2, Azure SQL, SQL MI, and optionally Databricks.

• Construct Power BI semantic models and reports that are integrated with Fabric.

• Implement CI/CD pipelines utilizing Azure DevOps or GitHub.

• Ensure adherence to data governance, security, and compliance standards.

• Mentor junior engineers, lead POD delivery, and promote best practices.

• Contribute to solution accelerators, reusable frameworks, prototypes, pre-sales activities, and the evaluation of emerging technologies.

• Take part in Agile ceremonies and act as a technical liaison for stakeholders and clients.

• Travel to customer locations as necessary, up to 50% of the time.

⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• A minimum of 8 years of experience in Data Engineering.

• At least 3 years of experience working within the Azure ecosystem.

• Strong practical knowledge of Microsoft Fabric, including OneLake, Lakehouse architecture, Data Factory in Fabric, Synapse Data Engineering/Data Warehousing, and Power BI integration.

• Proficiency in Python, PySpark, SQL, and Spark-based processing.

• Solid experience in constructing both batch and streaming data pipelines.

• Expertise in star/snowflake schemas and medallion architecture.

• Familiarity with Azure Data Factory/Synapse Pipelines, ADLS Gen2, Azure SQL, and SQL MI.

• Experience with CI/CD, version control, and DevOps methodologies.

• Understanding of data governance, security, access control, RBAC, IAM, and encryption.

• Experience with structured, semi-structured, and unstructured data sources.

• Strong skills in problem-solving, communication, and stakeholder management.

• Ability to collaborate across functions with product managers, business stakeholders, and engineering teams.

• Enthusiasm for current cloud and AI/ML technologies and the capability to assess emerging tools and methodologies.

• Microsoft certifications are preferred, including Fabric Analytics Engineer Associate, Fabric Data Engineer Associate, Azure AI Engineer Associate, and Azure Solutions Architect Expert.

• Experience with Databricks or Synapse Spark pools is a plus.

• Familiarity with real-time analytics and streaming architecture is desirable.

• Exposure to Purview or similar data governance tools is advantageous.

• Experience in building enterprise-scale data platforms is preferred.

🏝️ Benefits

• Medical, Dental, and Vision coverage.

• Critical Illness, Accident, and Hospital insurance.

• 401(k) Retirement Plan with options for pre-tax and Roth post-tax contributions.

• Voluntary Life Insurance and AD&D for employees and their dependents.

• Short and Long-Term Disability coverage.

• Health Spending Account (HSA).

• Transportation Benefits.

• Employee Assistance Program.

• Paid Time Off/Leave (PTO, Vacation or Sick Leave).

• Potential for additional earnings through annual bonuses, profit-sharing, and other incentive programs.

• Fully remote position.