Senior Software Architect – Deep Learning, HPC Communications

This is a fully remote position, open to applicants in California, +3 more states.

📋 Description

• Analyze opportunities to enhance communication performance by pinpointing bottlenecks in existing systems.

• Develop and implement innovative communication technologies to expedite AI and HPC workloads.

• Investigate cutting-edge solutions in hardware and software for our upcoming platforms as part of co-design initiatives involving GPU, Networking, and software architects.

• Create proofs-of-concept, carry out experiments, and conduct quantitative modeling to assess and promote new innovations.

• Utilize simulation techniques to evaluate the performance of large GPU clusters (consider scales of hundreds of thousands of GPUs).

⛳️ Requirements

• M.S./Ph.D. degree in Computer Science/Computer Engineering or equivalent experience.

• Over 12 years of pertinent experience.

• Proficient in C/C++ programming and debugging.

• Familiarity with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).

• Comprehensive understanding of operating systems, computer architecture, and system architecture.

• Strong grasp of network architecture fundamentals, topology, algorithms, and communication scaling pertinent to AI and HPC workloads.

• Extensive experience with Linux.

• Capability and adaptability to work and communicate effectively in a multinational, multi-time-zone corporate setting.

🏝️ Benefits

• Equity

• Benefits