Senior System Software Engineer – Dynamo-Triton Inference Server

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• Create top-tier GPU-accelerated AI inference serving software.

• Participate in feature development and promote widespread customer adoption.

• Lead the integration of the Triton Inference Server and NVIDIA Dynamo stacks to create a cohesive, high-performance inference platform.

• Ensure feature equivalency and efficiently support both Large Language Model (LLM) and non-LLM workloads.

• Develop resilient software suitable for deployment in production server or cloud settings.

• Optimize and balance prediction throughput alongside latency.

• Innovate and implement the next generation of inference technologies.

⛳️ Requirements

• MS or PhD in Computer Science or a related field (or equivalent experience).

• Over 5 years of professional experience in deep learning software development.

• Proficient in Rust and C++ programming languages.

• Knowledge of Python.

• Strong programming and software design abilities, including debugging, performance analysis, and test design.

• Experience with large-scale distributed systems and machine learning systems.

• Excellent communication skills and the ability to thrive in a fast-paced, agile team environment.

🏝️ Benefits

• Equity.

• Comprehensive benefits package.