This is a fully remote position, open to applicants in California, +2 more states.

📋 Description

• Create AI networking communication frameworks and applications that operate in production environments on the largest supercomputers and data centers worldwide.

• Develop tools and benchmarks for production that are utilized by various teams both within and outside of NVIDIA.

• Facilitate the integration of new AI models within the benchmarking framework and provide insights through comprehensive analysis of large-scale workloads spanning hardware and software stacks.

• Design and implement automation systems, including extensive parameter searches to determine optimal configurations across intricate systems.

• Work collaboratively with networking and hardware teams to co-develop innovative features and software interfaces.

⛳️ Requirements

• B.Sc. or M.Sc. degree in Computer Science, Software Engineering, or a related field, or equivalent professional experience.

• Over 5 years of relevant experience.

• Proven experience in professional Python development.

• Strong expertise in Linux environments.

• Capability to operate across a wide and evolving technology stack, encompassing hardware, networking, and large-scale AI systems across entire clusters.

• Familiarity with PyTorch, LLMs, and both inference and training processes.

• Experience with cluster orchestration systems such as Slurm or Kubernetes.

• Understanding of MPI and HPC, along with InfiniBand, Ethernet, and Networking.

• Background in performance optimization techniques.