Staff Infrastructure Engineer – Data Streaming

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the design and management of distributed data services, such as self-hosted Kafka and Redis, within Kubernetes clusters and across multi-cloud environments.

• Develop automated, self-service infrastructure spanning AWS, GCP, and isolated on-premises environments.

• Administer data infrastructure capable of supporting ingestion rates exceeding 5 PB/day while ensuring low-latency, high-throughput, and cost-effective operations.

• Streamline and enhance multi-tenant Kafka clusters.

• Propel Redis and Kafka lifecycle automation by leveraging GitOps methodologies, ArgoCD, and Terraform.

• Establish and execute standards for observability, high availability, backup, and disaster recovery for stateful Kubernetes workloads.

• Collaborate with FinOps and engineering partners to enhance performance, minimize costs, and reduce operational overhead.

• Manage the comprehensive platform experience for critical open-source systems that support numerous product teams.

• Work alongside teams in Europe and India utilizing Kubernetes, Jenkins, GitHub Actions, ArgoCD, and Terraform.

⛳️ Requirements

• A minimum of 8 years of experience in infrastructure/platform engineering.

• Demonstrated success in operating stateful distributed systems at scale.

• Extensive hands-on experience with self-hosted Kafka and Redis in Kubernetes, covering performance tuning, scaling, partitioning, persistence, and operator-based lifecycle management.

• Strong grasp of Kubernetes internals and the production management of both stateless and stateful workloads.

• Experience in delivering Database- or Messaging-as-a-Service (DBaaS/PaaS).

• Familiarity with multi-cloud environments, with significant expertise in AWS, GCP, or Azure.

• Proficient in Infrastructure as Code and GitOps practices, including Terraform, ArgoCD, or Pulumi.

• Knowledge of blue-green, canary, and rolling deployment strategies.

• Strong skills in scripting or development, particularly in Python or Go.

• Comprehensive understanding of CI/CD pipelines and workflow automation.

• U.S. Citizenship is required.

• FedRAMP personnel may be subjected to customer or third-party background checks, potentially up to and including Secret Clearance if required by the role.

🏝️ Benefits

• Restricted Stock Units (RSUs).

• Employee Stock Purchase Plan (ESPP).

• Flexible time off.

• Paid company holidays and sick leave.

• Gender-neutral parental leave.

• Grandparent leave.

• Medical, dental, and vision insurance coverage.

• 401(k) retirement plan with company matching.

• Life and disability insurance.

• Health and dependent care FSA.

• Optional benefits (hospital, accident, critical illness).

• Employee Assistance Program (EAP).

• ARAG pre-paid legal services.

• Nationwide pet insurance.

• Cancer Care program.

• Global business travel medical insurance.

• Home office allowance.

• Mobile phone reimbursement.

• Wellness coach.

• Wellness/gym reimbursement.

• Fertility coverage.

• Adoption and surrogacy reimbursement.