Principal Architect, AI Networking

This is a fully remote position, open to applicants in California, +3 more states.

📋 Description

• Establishing the long-term technical strategy for distributed AI communication systems

• Performing original research and creating prototypes for next-generation networking solutions

• Leading hardware-software co-optimization efforts across diverse technologies

• Analyzing fundamental limitations in communication runtimes for large-scale AI workloads

• Incorporating networking functionalities into AI serving architectures

• Publishing research outcomes and representing NVIDIA at industry forums and standards organizations

• Guiding senior engineers throughout the organization

⛳️ Requirements

• Over 15 years of experience in systems software and/or networking

• Extensive expertise in high-performance networking technologies (InfiniBand, RoCE, RDMA, NVLink)

• Knowledge of communication libraries (e.g., NIXL, NCCL, UCX, MPI, NVSHMEM)

• Experience with GPU-accelerated systems

• Proven history of defining and executing complex technical projects across teams

• MS, PhD, or equivalent degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field

• In-depth understanding of computer architecture, memory hierarchies, DMA engines, and OS-level networking

• Familiarity with machine learning systems concepts (transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns)

• Proficiency in programming languages such as C, C++, Rust, and Python

🏝️ Benefits

• Competitive salaries

• Comprehensive benefits package

• Eligibility for equity