Senior Lustre Engineer

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• Contribute to the architecture of Lustre and spearhead the implementation of new features across core subsystems, such as MDS/OSS, LDLM, DNE, DoM, FLD, layout, snapshot, quota, security, and recovery.

• Develop high-performance, production-quality code within the Lustre kernel module, user-space utilities, and related libraries.

• Take ownership of the entire development lifecycle for significant features, from design and coding to testing, performance optimization, and upstream patch submission.

• Enhance scalability for multi-petabyte Lustre environments, focusing on metadata performance, I/O path optimization, and integration with contemporary interconnects and storage fabrics.

• Modernize the internal structure of Lustre through updates to kernel APIs, improvements in locking, RDMA enhancements, and capabilities oriented towards cloud/container environments.

• Prototype and assess emerging technologies like NVMe-oF, CXL, and other next-generation storage solutions for potential integration with Lustre.

• Reinforce regression, stress, and performance validation utilizing tools such as IOR, mdtest, fio, and custom Lustre testing tools.

• Conduct in-depth code-level performance analysis with Lustre tracing tools, perf, lockstat, and kernel profilers.

• Collaborate closely with Principal Engineers, hardware teams, and application owners to translate actual workload requirements into actionable Lustre enhancements.

• Mentor fellow developers and contribute to design documents, technical guides, and engineering reviews.

⛳️ Requirements

• Over 7 years of progressive, hands-on experience in Lustre software development.

• A proven track record of significant contributions to the Lustre codebase in both production and open-source environments.

• Demonstrated success in designing, implementing, and upstreaming Lustre features that have been included in major releases.

• In-depth knowledge of Lustre internals, including MDS/OSS architecture, LDLM locking and recovery, journaling, DNE, DoM, FLD, layout, quota, and security.

• Expert-level proficiency in C programming and substantial experience in Linux kernel development.

• Strong understanding of distributed systems, parallel file systems, and high-performance I/O.

• Familiarity with Lustre build, development, and debugging tools such as lctl, llstat, strace, perf, and kernel tracers.

• Proficiency in Python and/or Bash for tooling and automation.

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related discipline.

• Excellent written and verbal communication skills, with the ability to convey complex technical concepts clearly.

🏝️ Benefits

• Competitive salary and comprehensive benefits package.

• Opportunities for professional development and career advancement.

• Collaborative work environment with a focus on innovation and technology.