GPU Cluster Architect

atNebius GroupRemoteUS flagUnited StatesFull-timeArchitectMid-levelSenior$184k – $318k/year

Posted Sep 28

This is a fully remote position, open to applicants in United States.

📋 Description

• Design scalable GPU cluster architectures, including compute nodes, InfiniBand/Ethernet interconnects, storage, and control planes.

• Evaluate AI/ML workloads such as LLM training and inference to guide decisions on latency, bandwidth, and GPU-density trade-offs.

• Collaborate with network architects to validate low-latency, high-throughput interconnects like InfiniBand HDR/NDR and RoCEv2 at both POD and data-center levels.

• Coordinate with storage teams to enhance performance for training datasets and checkpointing processes.

• Assess monitoring-system signals to identify design imperfections.

• Work alongside site reliability, networking, storage, and data-center engineering teams to implement and scale the architecture effectively.


⛳️ Requirements

• Over 5 years of experience in cluster design.

• Profound knowledge of contemporary GPU architecture, including NVIDIA and AMD technologies.

• Familiarity with HPC interconnects, such as InfiniBand and RoCE.

• Strong foundation in systems architecture, networking, and hardware reliability.

• Proficient in scripting for automation and telemetry pipelines using languages like Python, Go, or similar.

• Must possess authorization to work in the United States and provide proof of employment eligibility.


🏝️ Benefits

• Comprehensive medical, dental, and vision coverage fully paid by the company for employees and their families.

• 401(k) plan featuring up to 4% company matching and immediate vesting.

• 20 weeks of paid parental leave for primary caregivers.

• 12 weeks of paid parental leave for secondary caregivers.

• Remote work reimbursement of up to $85/month for mobile and internet costs.

• Company-funded short-term, long-term, and life insurance coverage.

• Potential for equity in the form of RSUs at specific salary grades.

• Opportunities for professional development within Nebius.

• Hybrid working options available.

• Competitive salary along with a comprehensive benefits package.

• Career advancement and learning opportunities.

• Flexibility and a sense of ownership in your work.

• A collaborative and innovative workplace culture.

• Chance to engage in significant AI projects.

• An international environment with talented teams.

People also viewed

Salesforce12 hours ago

Experience Architect

BR flagBrazil OnlyFull-timeArchitect
ApplyView job
WRA, Inc.13 hours ago

Landscape Architect

US flagCalifornia, +1 more stateFull-timeArchitect$105k – $140k/year
ApplyView job
Akamai Technologies13 hours ago

Senior Technical Enablement Architect

CR flagCosta Rica OnlyFull-timeArchitect
ApplyView job
Polaris Inc.13 hours ago

Application Architect

US flagMinnesota OnlyFull-timeArchitect$150k – $175k/year
ApplyView job
Weekday (YC W21)14 hours ago

Business Architect

IN flagIndia OnlyFull-timeArchitect₹1.5M – ₹2.8M/year
ApplyView job
VSP Vision Care15 hours ago

Principal Architect

US flagUnited States OnlyFull-timeArchitect
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers