Software Engineer, SRE, Production Engineering – DGX Cloud

This is a fully remote position, open to applicants in California, +5 more states.

📋 Description

• Develop automation solutions for bare-metal provisioning, hardware validation, firmware and software upgrades, repairs, and cluster lifecycle management.

• Create tools using BMC and Redfish interfaces to evaluate hardware health, manage server states, and support recovery workflows.

• Oversee and improve NVIDIA NVL72 systems and BlueField-3 or later DPUs within cloud partner and on-premises settings.

• Troubleshoot failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes; transform recurring issues into automated detection and resolution.

• Establish validation and handoff criteria to ensure that new capacity is introduced into production safely and consistently.

• Participate in on-call responsibilities, incident response, root-cause analysis, and ensure the implementation of permanent fixes.

• Collaborate with hardware, networking, platform, data center operations, and partner teams to address issues across various ownership boundaries.

⛳️ Requirements

• 8+ years of experience in building software for or managing production infrastructure, with significant hands-on bare-metal expertise.

• Proficient in Go or Python, with a proven track record in delivering production automation and services.

• Direct experience with BMC and Redfish for server provisioning, health monitoring, power control, or fault diagnosis.

• Practical experience with NVIDIA GPU hardware, specifically NVL72 systems, and BlueField-3 or later DPUs.

• Knowledge of Linux, firmware and driver management, network boot processes, and the server lifecycle from initial provisioning to repair.

• Experience in managing production reliability through on-call responsibilities, incident management, observability, and sustainable solutions.

• Capability to debug failures across hardware, host operating systems, networking, and distributed services.

• Strong communication skills and a demonstrated ability to take ownership of issues that involve multiple teams.

• BS/MS in Computer Science or equivalent experience in a related area.

• Experience in operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle debugging, or similar experience.

• Background in NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation.

• Experience in creating safe, repeatable workflows for rack-scale bring-up, firmware upgrades, hardware replacement, and customer transitions.

• Familiarity with Kubernetes, GitOps, Argo CD, SLOs, and fleet-wide automation.

🏝️ Benefits

• Equity

• Benefits