Staff Software Engineer – Ingestion Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Spearhead the development and advancement of Reddit’s Ingestion Platform.

• Design, create, and deliver dependable software for distributed data movement across both streaming and batch workloads.

• Oversee the architecture and progression of the platform’s control plane and data plane.

• Enhance the platform to accommodate S3/GCS, Apache Iceberg, transformations, deduplication, dead-letter queues, and reusable capabilities.

• Develop connectors and abstractions for Kafka, BigQuery, S3, GCS, Iceberg, Flink, and various other data stores.

• Elevate the self-service experience through APIs, safe defaults, automated provisioning, documentation, onboarding workflows, observability, and alerting.

• Direct migrations from custom and legacy ingestion systems to the Ingestion Platform.

• Establish reliability, security, and operational standards for pipelines across Kubernetes clusters.

• Identify architectural and product-experience deficiencies and lead redesign efforts.

• Collaborate with Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams.

• Mentor and support backend and data infrastructure engineers throughout the organization.

⛳️ Requirements

• Over 10 years of hands-on experience in building internet-scale distributed systems, data infrastructure, or platforms utilized by other developers.

• BS, MS, PhD in Computer Science, a related field, or equivalent practical experience.

• Proficient software development experience in one or more general-purpose languages such as Go, Python, Java, or Scala.

• Extensive experience in designing and operating high-throughput, fault-tolerant data pipelines or platform services, including both streaming and batch processing.

• Familiarity with Kafka, BigQuery, S3, GCS, Apache Iceberg, Flink, or similar technologies.

• Experience in designing APIs and platform abstractions, including schema evolution, Protocol Buffers, and gRPC.

• Knowledge of Kubernetes and cloud-native platform concepts, including controllers, custom resources, workload identity, infrastructure automation, and multi-cluster deployments.

• Strong grasp of observability and operational excellence: metrics, logging, alerting, SLOs, incident response, data quality, and safe migration practices.

• A product-oriented mindset focused on advocating for platform users and transforming ambiguous needs into reliable, scalable solutions.

• Proven technical leadership and experience guiding teams through complex, cross-functional projects.

• Outstanding written and verbal communication skills.

• Experience in developing low-code or self-service developer platforms, or a strong desire to learn, is a significant advantage.

🏝️ Benefits

• Equity in the form of restricted stock units.

• Eligibility for commission based on the position offered.

• Medical insurance.

• Dental insurance.

• Vision insurance.

• 401(k) program with employer match.

• Generous vacation time off.

• Parental leave.

• Reasonable accommodations for qualified individuals with disabilities and disabled veterans.

• Opportunity to opt out of interview recording, transcription, and summarization.