Cluster Architect

This is a fully remote position, open to applicants in California.

📋 Description

• Design, implement, and manage large-scale GPU clusters for AI laboratories and computing service providers.

• Take ownership of reference designs for both current and upcoming NVIDIA platforms.

• Transform customer requirements into comprehensive cluster designs encompassing compute, fabric, storage, management, power, and cooling interfaces.

• Serve as the technical authority for every build project.

• Develop customer configurations, bills of materials, and rack layouts tailored to workload, scale, and site specifications.

• Evaluate training and inference workloads to assess trade-offs involving latency, bandwidth, and GPU density.

• Design within set site power limits while optimizing GPU density and maintaining headroom for storage, networking, and services.

• Conduct technical reviews of vendor quotes and bills of materials.

• Establish burn-in, performance, and acceptance tests to ensure cluster readiness.

• Verify power, cooling, and space requirements against potential data center candidates.

• Collaborate across various sites, vendors, and platforms.

⛳️ Requirements

• Proven experience in designing and delivering GPU clusters exceeding 1,000 GPUs.

• In-depth knowledge of NVIDIA HGX and NVL72 systems as well as SuperPOD reference architectures.

• Familiarity with InfiniBand and Spectrum-X fabrics.

• Understanding of parallel storage systems including VAST, WEKA, and DDN.

• Proficient in using Slurm or Kubernetes cluster management stacks.

• Knowledge of rack power and liquid cooling systems.

• Comprehension of how facility constraints influence design choices.

• Experience with NCCL, HPL, and MLPerf benchmarking and cluster acceptance processes.

• Background in delivering GB200 or GB300 NVL72 deployments.

• NVIDIA-certified architect or possess an equivalent certification.

🏝️ Benefits

• Comprehensive benefits package for you and your dependents.

• Healthcare coverage.

• Dental coverage.

• Vision coverage.

• 401(k) plan.

• Unlimited Paid Time Off (PTO).

• Equal opportunity and inclusive work environment.