Storage Platform Engineer

Posted 7 hours ago

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Lead the design and architecture of Supabase's NVMe-oF storage platform.

• Assess current software-defined storage options versus creating solutions on SPDK.

• Integrate networked block storage into the Kubernetes-based computing environment utilizing CSI drivers and custom controllers.

• Manage provisioning, attach/detach operations, resizing, and migration processes.

• Profile and optimize the complete Postgres I/O path, including fsync, WAL, checkpoints, the kernel block layer, NVMe/TCP, and networking aspects.

• Ensure durability and availability through mechanisms such as replication or erasure coding, failure domains, failover strategies, and data-integrity checks.

• Implement I/O isolation and Quality of Service (QoS) to mitigate noisy-neighbor issues.

• Establish performance and reliability Service Level Objectives (SLOs) and develop benchmarking and observability metrics.

• Design block-level snapshots and copy-on-write clones for database branching functionality.

• Maintain platform portability across AWS, various cloud services, and bare-metal/colocation environments.

• Produce design documentation and provide mentorship to engineering teams.

• Collaborate effectively with Compute, Branching, Postgres, and Multicloud teams.

• Engage in on-call rotations, incident response activities, and post-incident evaluations.

• Address escalated support concerns and systemic platform challenges.

• Oversee the storage initiative comprehensively, covering architecture, build-or-buy choices, integration, and operational deployment.


⛳️ Requirements

• 7+ years of software engineering experience, with substantial involvement in the development and maintenance of production storage systems.

• Proven experience in building or managing distributed or software-defined block storage solutions.

• Practical experience with NVMe/TCP or NVMe-oF, focusing on targets, initiators, multipathing, and failover functionalities.

• In-depth knowledge of Linux storage internals, including the block layer, io_uring, page cache, O_DIRECT and fsync semantics, filesystems, and device-mapper.

• Proficient in systems programming languages such as Go, alongside C, C++, or Rust.

• Experience in performance measurement using tools like fio, pgbench, eBPF, and perf.

• Awareness of durability trade-offs between replication, erasure coding, and consistency during failure scenarios.

• Demonstrated experience in guiding technical direction on complex systems.

• Familiarity with Kubernetes controllers and/or CSI drivers.

• Previous on-call experience for large-scale production systems.

• Exceptional written communication skills and the ability to excel in asynchronous, globally distributed teams.

• Passport Country and Country of Residence must be included in the application form.

• Candidates must be over the age of 18.

• GitHub and LinkedIn profiles are essential.

• Experience with SPDK development, RDMA/RoCE, block-level snapshots, thin provisioning, copy-on-write cloning, Postgres internals, AWS networking and instance storage, bare-metal/colo storage, and contributions to open-source or Linux kernel storage projects are advantageous.


🏝️ Benefits

• Fully Remote work environment.

• WeWork membership or co-working allowance valid anywhere globally.

• Employee Stock Ownership Plan (ESOP) for every team member.

• Technology allowance for acquiring laptops, monitors, headphones, or other necessary work equipment.

• Supabase covers 100% of health insurance for employees and 80% for dependents.

• Annual off-site team gatherings.

• Flexible working arrangements with asynchronous scheduling.

• Annual budget for education, including courses, books, conferences, or other professional development opportunities.

People also viewed

RTX7 hours ago

Lead Platform Engineer

US flagConnecticut OnlyFull-timePlatform Engineer$132.4k – $251.6k/year
ApplyView job
ECP7 hours ago

Lead AI Engineer, Platform

US flagUnited States OnlyFull-timePlatform Engineer
ApplyView job
CSAA Insurance Group, a AAA Insurer7 hours ago

Senior Director, Platform Engineering

US flagUnited States OnlyFull-timePlatform Engineer
ApplyView job
Clarity Innovations, Inc.7 hours ago

Principal Platform Engineer

US flagUnited States OnlyFull-timePlatform Engineer$111.7k – $189.9k/year
ApplyView job
Avenga16 hours ago

Observability Platform Engineer

GB flagUnited Kingdom OnlyFull-timePlatform Engineer
ApplyView job
Mirantis21 hours ago

Senior AI Infrastructure & Platform Operations Engineer

EuropeFull-timePlatform Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers