
Senior Software Engineer, SRE, Production Engineering
Posted Oct 12

Posted Oct 12
This is a fully remote position, open to applicants in California.
β’ Develop automation solutions for bare-metal provisioning, hardware validation, firmware and software upgrades, repairs, and the management of cluster lifecycles.
β’ Create tools that interface with BMC and Redfish to monitor hardware health, manage server states, and facilitate recovery workflows.
β’ Manage and enhance NVIDIA NVL72 systems and BlueField-3 or later DPUs in both cloud partner and on-premises environments.
β’ Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes, transforming recurring issues into automated detection and repair processes.
β’ Establish validation and handoff criteria to ensure that new capacities are safely and consistently integrated into production.
β’ Participate in on-call responsibilities, incident response, root-cause analysis, and follow-up actions to implement lasting solutions.
β’ Collaborate with hardware, networking, platform, data center operations, and partner teams to resolve issues that cross ownership boundaries.
β’ Over 8 years of experience in building software for or operating production infrastructure, with significant hands-on bare-metal expertise.
β’ Proficient in Go or Python, with a proven track record of delivering production automation and services.
β’ Direct experience with BMC and Redfish for server provisioning, health inspection, power management, or fault diagnosis.
β’ Practical experience with NVIDIA GPU hardware, including NVL72 systems and BlueField-3 or newer DPUs.
β’ Familiarity with Linux, firmware and driver management, network boot processes, and the server lifecycle from initial provisioning to repair.
β’ Experience in managing production reliability through on-call responsibilities, incident response, observability, and sustainable solutions.
β’ Ability to troubleshoot failures across hardware, host operating systems, networking, and distributed services.
β’ Strong communication skills and proven ownership of issues that involve multiple teams.
β’ BS/MS in Computer Science or equivalent practical experience.
β’ Experience operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle debugging, with equivalent DPU experience considered.
β’ Background in NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation.
β’ Experience in creating safe, repeatable workflows for rack-scale bringup, firmware upgrades, hardware replacements, and customer handoffs.
β’ Familiarity with Kubernetes, GitOps, Argo CD, SLOs, and fleet-wide automation.
β’ Equity
β’ Benefits
Prime Intellect
NVIDIA
NVIDIA
GitLab
Get handpicked remote jobs straight to your inbox weekly.