AI Cluster Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Design large-scale GPU clusters within fixed site power budgets to maximize GPU density while allowing headroom for compute services, storage, and networking.

• Model and assess power consumption across the complete cluster bill of materials, which includes GPUs, CPUs, NICs, switches, fabric components, storage, and facility limits.

• Evaluate various fabric architectures such as InfiniBand, RoCE, and SpectrumX, including multi-plane, 2-tier/3-tier, and rail-optimized topologies.

• Establish network scale limits based on switch radix, link speed, topology, and blocking requirements.

• Collect, interpret, and maintain SKU-level power and thermal specifications for GPUs, NICs, switches, DPUs, storage, and server platforms.

• Create power-aware cluster configuration templates and capacity-planning models for sites with diverse constraints.

• Document architecture, design decisions, tradeoff analyses, and operational considerations for deployment and lifecycle management.

• Provide insights on future-proofing strategies for next-generation GPUs, NICs, and fabrics.

• Collaborate with vendors on innovative fabric architectures that support large-scale cluster deployments of over 100k GPUs.

⛳️ Requirements

• 7+ years of experience in designing or constructing large-scale HPC, AI, or hyperscale GPU clusters.

• In-depth knowledge of GPU and accelerator system design, including node topology, PCIe/NVLink/NVSwitch/ROCm, and NIC-to-GPU affinity considerations.

• Strong understanding of InfiniBand, RoCE, and SpectrumX networking, including multi-tier, multi-plane, Clos/dragonfly variants, and large-radix switch design.

• Proven experience in modeling power draw and thermal characteristics of servers, GPUs, NICs, switches, optics, and storage systems.

• Capability to design networks that maintain full non-blocking performance or intentionally introduce over/under-subscription while comprehending the impacts on workload performance.

• Demonstrated ability to gather and analyze vendor SKU-level specifications and integrate them into scalable cluster architectures.

• Experience in balancing customer-driven requirements for compute, storage, and service density alongside overall GPU count.

• Strong skills in documentation, communication, and cross-functional collaboration.

🏝️ Benefits

• 100% company-paid insurance premiums for employee medical, dental, and vision plans.

• 401(k) plan that matches 100% up to 4%, with immediate vesting.

• Professional Development Reimbursement of $2,500 each year.

• 11 Holidays + Paid Time Off Accrual + Rollover Plan.

• Increased PTO at 3 year and 10 year anniversaries.

• 1 month paid sabbatical every 5 years.

• Anniversary Bonus each year.

• $500 stipend for remote office setup in the first year + $400 each following year.

• Internet reimbursement up to $75 per month.

• Gym membership reimbursement up to $50 per month.

• Company paid Wellable subscription.