Lead Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Oversee the comprehensive design and execution of scalable data pipelines and solutions utilizing Snowflake, Snowflake Openflow (Apache NiFi), and dbt.

• Convert business and data requirements into technical designs, data flows, integration patterns, data models, and implementation strategies.

• Develop and maintain Openflow ingestion and orchestration flows, dbt transformation models, and efficient Snowflake workloads.

• Create reusable patterns for batch, change data capture, API, and file-based ingestion that include validation, reconciliation, restartability, and recovery mechanisms.

• Write advanced SQL and Python, engaging in code reviews, troubleshooting, performance tuning, and resolving complex issues.

• Ensure high standards of data quality, security, scalability, maintainability, observability, and cost efficiency.

• Work collaboratively with architecture, analytics, platform, security, application, and business teams.

• Maintain technical documentation and establish reusable engineering standards.

• Lead Data Operations support efforts, managing priorities, handoffs, and issue resolution among India-based data colleagues.

• Implement best practices for source control, peer review, testing, CI/CD, deployment, documentation, and production readiness.

• Guide and mentor colleagues through design and code reviews while fostering cross-training initiatives.

• Take ownership of and enhance Data Operations, including incident response, escalation protocols, runbooks, recovery processes, and service expectations.

• Promote automated monitoring, alerting, and recovery across data platforms and pipeline workloads.

• Monitor service health and incident trends, conduct root-cause analysis, and enhance reliability and operational efficiency.

⛳️ Requirements

• Bachelor's degree in computer science, engineering, information systems, or a related field, or an equivalent mix of education and relevant experience.

• Over 10 years of practical data engineering experience, including a minimum of 2 years in leading technical delivery or production operations.

• Extensive production experience with cloud data technologies such as Snowflake, AWS, Azure, or GCP.

• Strong hands-on expertise with dbt.

• Familiarity with Git-based development, automated testing, CI/CD, Terraform, and sustainable environment-promotion practices.

• Proficient in advanced SQL.

• Experience in constructing maintainable, testable production data pipelines and data products.

• Experience in designing ETL/ELT solutions encompassing batch, CDC, API, and file-based ingestion.

• Knowledge of data modeling, quality, validation, and recovery techniques.

• Excellent solution-design, communication, and technical leadership abilities.

• Capacity to guide decision-making, mentor engineers, and collaborate across business and technology teams.

🏝️ Benefits

• Comprehensive medical coverage for employee, spouse, two children, and two parents.

• ₹6 lakhs annual medical coverage.

• Optional ₹5 lakhs medical top-up.

• Employer provident fund contribution of ₹1,800 per month.

• Annual performance-based bonus of up to 5% of base salary.

• Bucketlist point-based rewards redeemable for gift cards, experiences, and personalized perks.

• Recognition of milestones, achievements, and contributions.

• Currently a remote work model, transitioning to hybrid in the future.

• 15 annual leaves.

• 6 casual leaves.

• 12 sick leaves.

• Opportunities for upskilling, mentorship, and professional development resources.

• Internal mobility programs.

• Leadership development, industry certifications, and specialized training.

• Collaborative knowledge sharing and exposure to global teams.