Senior System Software Engineer – Dynamo

📋 Description

• Create open-source software to facilitate the inference of trained AI models operating on GPUs.

• Participate in the advancement of disaggregated serving for inference engines supported by Dynamo (vLLM, SGLang, TRT-LLM).

• Innovate in the management and transfer of substantial KV caches across diverse memory and storage hierarchies.

• Develop new features for the Dynamo Rust Runtime Core Library and design, implement, and enhance distributed inference components using Rust and Python.

• Balance multiple objectives: create robust, scalable, and high-performance software components to support our distributed inference workloads.

⛳️ Requirements

• Master's or PhD degree or equivalent professional experience.

• Over 3 years of experience in Computer Science, Computer Engineering, or a related discipline.

• Strong skills in Rust, Python, and C++ programming and software design, including debugging, performance analysis, and test design.

• Familiarity with high-scale distributed systems and machine learning systems.

🏝️ Benefits

• Equity.

• Benefits.