Software Engineer, Storage

This is a fully remote position, open to applicants in United States, +5 more locations.

📋 Description

• Design, develop, and enhance the core storage pathways of AccountsDB, which include the layout of account files, account indexing, and the layers for read/write caching.

• Minimize memory and disk usage as the account state evolves.

• Enhance the processes of flushing, cleaning, shrinking, and purging to decrease write amplification and ensure consistent resource utilization.

• Optimize the generation of snapshots, loading processes, and index creation to accelerate validator startup and catch-up durations.

• Guarantee the accuracy of account states during forks, rooting, and recovery from crashes.

• Design and implement thorough tests for the storage engine, which encompass stress testing, fault injection, and performance evaluation.

• Collaborate with teams focused on runtime, block production, core protocol, and other Solana client initiatives.

• Keep AccountsDB documentation up to date and perform peer code assessments.

• Contribute to Anza’s Agave client as well as the wider Solana network.

⛳️ Requirements

• A Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience.

• Over 3 years of experience in designing data storage solutions, file systems, databases, or high-throughput storage systems.

• Proficiency in Rust, C, or C++ programming languages.

• In-depth understanding of low-level storage operations, including memory-mapped files, page caching, indexing structures, on-disk formats, and garbage collection techniques.

• Advanced familiarity with kernel-level and hardware I/O pipelines, NVMe limitations, buffered versus direct I/O, and modern asynchronous interfaces like io_uring.

• Strong knowledge of custom memory allocators, Linux kernel scheduling, page management, and I/O handling under high throughput conditions.

• Demonstrated experience in building concurrent systems, with a strong understanding of lock overhead, lock-free structures, and hardware memory models.

• Proven ability to profile and optimize low-level code with a focus on hardware mechanics, memory bus saturation, and CPU cache performance.

• Capability to debug complex software architectures, identify performance constraints, and implement effective engineering solutions.

• Outstanding communication abilities and a collaborative team spirit.

• Preferred: Experience with LSM trees, B-trees, or hash-based storage engines like RocksDB, LevelDB, or WiredTiger.

• Preferred: Experience in versioned or multi-version data stores, snapshotting systems, or blockchain state storage.

• Preferred: Knowledge of Linux, systems automation tools, and systems architecture.

• Preferred: Active involvement in Bitcoin, Ethereum, Blockchain projects, or the open-source community.

🏝️ Benefits

• A dynamic and fast-paced work environment.

• Opportunities to work on projects that significantly influence the security and scalability of blockchain technology.

• Contribute to the foundation of decentralized applications globally.