Lead Data Engineer – Data Architect

This is a fully remote position, open to applicants in India.

📋 Description

• Architecture and solution design expertise.

• Over 15 years of overall experience, including more than 10 years specializing in Data Engineering and Analytics solutions.

• Develop comprehensive data architectures utilizing Microsoft Azure.

• Define strategies for data ingestion, transformation, storage, governance, and consumption.

• Create scalable, secure, and cost-efficient data solutions that align with business objectives.

• Set architectural standards, design patterns, and best practices for data engineering teams.

• Work collectively with business stakeholders, product owners, and technical teams to convert requirements into technical solutions.

• Design, develop, and modernize enterprise data platforms on Azure, while analyzing, refactoring, and redesigning existing data pipelines and products to create new scalable data solutions.

• Serve as a hands-on individual contributor with technical leadership duties, including mentoring junior developers and promoting best practices.

• Proficient hands-on experience in PySpark, Python, and SQL.

• Expertise in Azure Databricks and the broader Azure data ecosystem.

• Experience in designing and implementing scalable data architectures.

• Ability to analyze, optimize, refactor, and redesign existing data pipelines.

• Develop and maintain ETL/ELT solutions along with data products.

• Conduct performance tuning, troubleshooting, and implement data quality measures.

• Mentor and guide junior developers while performing code reviews.

• Collaborate with cross-functional teams to deliver comprehensive end-to-end data solutions.

⛳️ Requirements

• Proficiency in Azure Data Lake, Azure Data Factory, and Azure Synapse.

• Experience with data warehousing, lakehouse architecture, and cloud migration.

• Familiarity with CI/CD methodologies, Git, and Agile development practices.

• Role Type: Senior Individual Contributor with Technical Leadership responsibilities.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health and wellness benefits.

• Opportunities for professional development and continuous learning.

• Flexible working conditions and a positive work-life balance.