Senior GPU Systems – Fabric Engineer

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• Design and sustain NVIDIA/AMD GPU device plugin and Kubernetes Operator integrations.

• Configure and enhance RDMA, SR-IOV, RoCEv2, and InfiniBand host networking for distributed AI training.

• Create automated hardware remediation pipelines utilizing DCGM telemetry.

• Implement and oversee GPU slicing technologies, including MIG and vGPU, for multi-tenant inference.

• Analyze and optimize kernel parameters, device drivers, and CUDA/NCCL runtime libraries.

• Collaborate with Scheduling and Storage engineering teams to ensure topology-aware placement and data movement.

• Establish operational standards for bare-metal provisioning, BIOS/firmware updates, and OS hardening.

• Lead investigations into performance issues related to hardware, fabric, and software.

• Mentor team members and uphold documentation standards for the AI hardware stack.

⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.

• Over 5 years of experience in systems engineering.

• Strong expertise in Linux kernel internals, C, or Go programming languages.

• Practical experience with GPU architectures (NVIDIA H100/A100), CUDA runtimes, and distributed networking (RDMA, InfiniBand).

• Profound understanding of containerized environments and the architecture of Kubernetes device plugins.

• Demonstrated success in operating, debugging, and scaling bare-metal systems in large-scale production or HPC settings.

• Familiarity with infrastructure automation tools such as Terraform, Ansible, and CI/CD pipelines.

• Strong analytical skills for tackling ambiguous hardware/software performance challenges.

• Excellent communication skills and a collaborative mindset across infrastructure, scheduling, and reliability teams.

• Experience in fast-paced, high-growth engineering environments is highly preferred.

🏝️ Benefits

• Equal employment opportunities in accordance with country, state, and local laws.