Senior Software Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and develop essential data-path components for managing requests and storage.

• Implement and enhance the handling of the Apache Kafka wire protocol, which includes parsing, framing, versioning, and ensuring backward compatibility.

• Construct and strengthen storage engines focusing on offset and sequence coordination, compaction, retention, and ensuring correctness under concurrent access.

• Identify race conditions, consistency edge cases, and potential security or robustness issues under concurrent loads.

• Profile and optimize throughput and latency based on actual production metrics.

• Take ownership of specific data path components from start to finish using Rust.

• Collaborate with the open-source community on Nisshi through code reviews, discussions, and contributions.

• Develop Solace Diskless Streaming for Apache Kafka, which separates computation from storage while utilizing object storage.

⛳️ Requirements

• Extensive hands-on experience in building high-throughput, log-based streaming or messaging systems, such as Apache Kafka or a similar platform, covering wire protocols, client/server compatibility, and data-loss prevention strategies.

• OR significant experience with database internals, including storage engines, write-ahead logs or commit logs, replication and consensus mechanisms, or query execution.

• Strong foundation in systems programming, particularly in Rust, C++, Go, or Java.

• Proven history of managing complex technical challenges from conception through to production.

• Comfort with remote and asynchronous work across various time zones.

• Preferred: practical experience with Rust in a production setting.

• Preferred: familiarity with the Apache Kafka protocol, client libraries, and its ecosystem.

• Preferred: hands-on experience with the internals of Apache Kafka, Redpanda, Pulsar, WarpStream, NATS JetStream, or Solace Event Broker.

• Preferred: experience in operating one of these systems at a production scale.

• Preferred: background in security hardening, fuzz testing, or performance engineering of network services.

🏝️ Benefits

• Flexibility with a hybrid-first approach.

• Opportunities for training and professional development.

• An inclusive and empowering work environment.

• A fair, inclusive, and transparent recruitment process.

• Accommodations available during the hiring process.

• Human review for interviews and final hiring decisions.

• Engagement in social activities and team culture.

• Flexibility for remote and asynchronous work.