Technical Data Lead – Fabric, Azure

This is a fully remote position, open to applicants in India.

📋 Description

• Lead the design and creation of enterprise-level data engineering solutions utilizing Microsoft Fabric and Azure.

• Create scalable and dependable data pipelines for both batch and real-time data processing.

• Develop and enhance ETL/ELT workflows leveraging contemporary Azure and Microsoft Fabric technologies.

• Engage extensively with Microsoft Fabric Data Factory, Lakehouse, Data Warehouse, OneLake, and associated Fabric components.

• Design and execute solutions employing Azure Data Factory, Azure Data Lake Storage Gen2, Azure Synapse Analytics, Azure SQL, and other Azure data services.

• Develop processes for data ingestion, transformation, cleansing, and integration from various source systems.

• Implement data models and data warehouse solutions that support analytics and reporting needs.

• Enhance the performance of data pipelines, queries, storage, and processing.

• Establish practices for data quality, security, governance, and monitoring.

• Collaborate with Data Architects, Solution Architects, BI Developers, and business stakeholders.

• Provide technical guidance and mentorship to data engineering teams.

• Engage in solution design, estimation, code reviews, troubleshooting, and production support.

⛳️ Requirements

• Over 10 years of relevant experience in Data Engineering / Data Platform development.

• Proficiency in Microsoft Fabric and Microsoft Azure is essential.

• Strong practical experience with Microsoft Fabric Data Factory.

• Hands-on experience with Fabric Lakehouse and Fabric Data Warehouse.

• In-depth knowledge of OneLake.

• Experience with data pipelines, notebooks, and Dataflows Gen2.

• Familiarity with Fabric architecture, workspace management, data ingestion, transformation, and optimization.

• Significant hands-on experience with Azure Data Factory (ADF).

• Experience with Azure Data Lake Storage Gen2, Azure Synapse Analytics, Azure SQL, Azure Databricks, and Azure Storage.

• Experience with Azure Functions / Logic Apps, Azure Key Vault, monitoring, and security services.

• Strong SQL and database development expertise.

• Proficiency in Python and/or PySpark.

• Solid understanding of ETL/ELT and data pipeline development.

• Background in data warehousing, dimensional modeling, and Lakehouse architecture.

• Knowledge of batch and real-time data processing.

• Experience with APIs and both structured and unstructured data sources.

• Familiarity with Git, CI/CD, and DevOps practices.

• Understanding of data security, governance, lineage, and data quality.

• Experience in troubleshooting and optimizing complex data pipelines.

• Proven capability to lead technical discussions and data engineering projects.

• Ability to convert business requirements into scalable technical solutions.

• Strong stakeholder management and communication abilities.

• Experience mentoring data engineers.

• Capacity to work independently in a remote setting.

• Strong analytical and problem-solving skills.

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.

• Available to start immediately or within 30 days.

🏝️ Benefits

• Remote / Work From Home opportunity.

• Chance to work on global enterprise data and cloud transformation initiatives.

• Experience with cutting-edge Microsoft technologies, including Microsoft Fabric and Azure.

• Exposure to international clients and large-scale data platforms.

• Opportunity to collaborate with a highly skilled and cooperative technology team.