Senior Software Engineer – Streaming, Kafka

This is a fully remote position, open to applicants in United States.

📋 Description

• Deploy and manage Kafka and Schema Registry on OpenShift utilizing Strimzi, which includes designing topics and partitions, establishing retention policies, ensuring security, and managing quotas.

• Revamp integrations that were developed on cloud queue services by implementing self-hosted brokers for numerous producer and consumer touchpoints.

• Create shared client patterns and libraries that handle retries, dead-letter queues, idempotent consumers, ordering guarantees, and backpressure management.

• Integrate messaging with the platform’s function runtime through KEDA-driven scaling of queue consumers.

• Take responsibility for messaging-tier capacity planning, which encompasses broker disk and IO sizing, throughput modeling, and ensuring growth headroom.

• Oversee consumer lag and broker health, conduct failure-mode testing, and strengthen the tier against node and site failures.

⛳️ Requirements

• Bachelor’s degree (B.E., B.Tech.) or Master’s degree (M.Sc.) in Computer Science or a related technical discipline.

• Over 5 years of experience in backend or data infrastructure roles.

• Extensive production ownership of Kafka, including operations and client-side development.

• Experience with running Kafka on Kubernetes, with a preference for Strimzi.

• Knowledge in managing schema evolution using Schema Registry.

• Practical experience with RabbitMQ, ActiveMQ/Artemis, or NATS/JetStream.

• Strong comprehension of delivery guarantees, idempotency, ordering, and exactly-once processing patterns.

• Professional programming experience in Java, Python, or Go.

• Familiarity with KEDA or event-driven autoscaling is a plus.

• Experience in regulated environments is advantageous.

🏝️ Benefits

• 20 days of guaranteed paid time off each year, in addition to company holidays.

• Comprehensive parental leave policy.

• Financial incentives and recognition across the company for impactful contributions and dedication.

• Medical, dental, and vision insurance coverage.

• Fully company-funded short- and long-term disability insurance.

• Fully company-funded basic life insurance.

• Discounted legal assistance.

• Pet insurance available.