Operations Engineer, HPC Networking

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the health and performance of InfiniBand and Ethernet fabrics including switches, HCAs, transceivers, and links.

• Analyze and resolve fabric-related issues such as connectivity, congestion, and performance regressions.

• Collaborate with DC operations and customer-facing teams to support fabric bring-up.

• Conduct maintenance and upgrades on switches and control plane components.

• Work alongside cluster operations on cross-domain incidents where the distinction between compute and network is unclear.

• Enhance tooling and runbooks to ensure quicker resolution of incidents compared to previous ones.

⛳️ Requirements

• Experience operating InfiniBand fabrics in a production environment, including subnet management, routing, partitioning, and monitoring.

• Proficient in debugging the entire stack, including cables, transceivers, switch firmware, HCAs, drivers, and NCCL.

• Successfully brought up new fabrics starting from cable installation through to validation.

• Capable of automating repetitive operational tasks using scripting languages such as bash, python, go, or others.

• Preferred: Familiarity with Ethernet RoCE, Spectrum-X, or large-scale GPU cluster networking.

🏝️ Benefits

• Competitive salary and comprehensive benefits package.

• Opportunities for professional development and career growth.

• Collaborative and innovative work environment.

• Flexibility in work arrangements and schedules.