Senior Manager, Data Engineering

This is a fully remote position, open to applicants in New York.

📋 Description

• Oversee the strategy, design, delivery, and operational excellence of extensive batch and real-time data platforms.

• Lead and develop data engineering teams responsible for batch and streaming data systems.

• Propel technical execution across ingestion, transformation, modeling, and serving layers.

• Set engineering standards, ensure code quality practices, and implement architectural review processes.

• Mentor engineers in the design of distributed systems, optimization of performance, and reliability of production systems.

• Cultivate operational excellence, accountability, continuous improvement, technical ownership, documentation, and collaboration.

• Direct scalable data modeling and enhance query performance across analytical workloads.

• Assist in making architectural decisions regarding orchestration, schema evolution, partitioning strategies, and storage optimization.

• Integrate batch and real-time data patterns into unified platform designs.

• Manage SLAs, oversee performance monitoring, address incidents, and plan for capacity.

• Collaborate with Data Product Management to prioritize roadmaps, SLAs, and platform KPIs.

• Work alongside software engineers to incorporate streaming systems, APIs, and microservices into the wider data ecosystem.

• Communicate architectural trade-offs, delivery risks, and operational constraints to stakeholders.

• Lead architectural reviews and guide the long-term strategy for the platform.

• Stay updated on cloud data platforms, distributed systems, and AI data infrastructure technologies.

⛳️ Requirements

• 7–8+ years of experience in data engineering, software engineering, or platform engineering roles.

• At least 5+ years of direct engineering management experience.

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field; advanced degree is preferred.

• Demonstrated experience leading engineering teams that deliver large-scale production data platforms.

• Strong expertise in data lakes, warehouses, and lakehouse architectures.

• In-depth knowledge of ETL/ELT frameworks, orchestration platforms, and distributed data processing systems.

• Solid understanding of Kafka-based architectures and event-driven data patterns.

• Experience in building and managing cloud-native data platforms within AWS, GCP, or OCI environments.

• Strong foundation in distributed systems engineering, scalability patterns, resiliency design, and high-availability architectures.

• Experience in optimizing performance, throughput, latency, and cost efficiency for large-scale data workloads.

• Proficient in containerized infrastructure and Kubernetes, along with familiarity in Infrastructure-as-Code and modern deployment practices.

• Proven track record in hiring, onboarding, and retaining high-performing engineers across various seniority levels.

• Strong skills in coaching, mentoring, and performance management.

• Expertise in sprint planning, capacity modeling, and roadmap sequencing.

• Ability to balance competing priorities across reliability, feature delivery, and reduction of technical debt.

• Experience in establishing engineering KPIs such as reliability, latency, throughput, and deployment frequency.

• Well-developed communication skills and the ability to collaborate effectively with diverse teams.

• Self-motivated, quality-focused, and dedicated to engineering excellence and operational discipline.

🏝️ Benefits

• Medical insurance.

• Dental insurance.

• Vision insurance.

• 401(k) plan.

• Life insurance coverage.

• Disability benefits.

• Tuition assistance program.

• PTO / generous paid time off.

• Bonus eligibility.

• Complimentary subscriptions to HBO Max, Paramount+, and other Skydance streaming services and digital news products.

• Exclusive screenings and events.

• Speaker series.

• Volunteer activities.

• Reasonable accommodation during the job application and/or recruitment process.