GPU Cluster Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Design scalable GPU cluster architectures, including compute nodes, InfiniBand/Ethernet interconnects, storage, and control planes.

• Evaluate AI/ML workloads such as LLM training and inference to guide decisions on latency, bandwidth, and GPU-density trade-offs.

• Collaborate with network architects to validate low-latency, high-throughput interconnects like InfiniBand HDR/NDR and RoCEv2 at both POD and data-center levels.

• Coordinate with storage teams to enhance performance for training datasets and checkpointing processes.

• Assess monitoring-system signals to identify design imperfections.

• Work alongside site reliability, networking, storage, and data-center engineering teams to implement and scale the architecture effectively.

⛳️ Requirements

• Over 5 years of experience in cluster design.

• Profound knowledge of contemporary GPU architecture, including NVIDIA and AMD technologies.

• Familiarity with HPC interconnects, such as InfiniBand and RoCE.

• Strong foundation in systems architecture, networking, and hardware reliability.

• Proficient in scripting for automation and telemetry pipelines using languages like Python, Go, or similar.

• Must possess authorization to work in the United States and provide proof of employment eligibility.

🏝️ Benefits

• Comprehensive medical, dental, and vision coverage fully paid by the company for employees and their families.

• 401(k) plan featuring up to 4% company matching and immediate vesting.

• 20 weeks of paid parental leave for primary caregivers.

• 12 weeks of paid parental leave for secondary caregivers.

• Remote work reimbursement of up to $85/month for mobile and internet costs.

• Company-funded short-term, long-term, and life insurance coverage.

• Potential for equity in the form of RSUs at specific salary grades.

• Opportunities for professional development within Nebius.

• Hybrid working options available.

• Competitive salary along with a comprehensive benefits package.

• Career advancement and learning opportunities.

• Flexibility and a sense of ownership in your work.

• A collaborative and innovative workplace culture.

• Chance to engage in significant AI projects.

• An international environment with talented teams.