Senior Software Engineer, SRE, Production Engineering

atNVIDIARemoteUS flagCaliforniaFull-timeProduction EngineerSenior$184k – $287.5k/year

Posted Oct 12

This is a fully remote position, open to applicants in California.

πŸ“‹ Description

β€’ Develop automation solutions for bare-metal provisioning, hardware validation, firmware and software upgrades, repairs, and the management of cluster lifecycles.

β€’ Create tools that interface with BMC and Redfish to monitor hardware health, manage server states, and facilitate recovery workflows.

β€’ Manage and enhance NVIDIA NVL72 systems and BlueField-3 or later DPUs in both cloud partner and on-premises environments.

β€’ Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes, transforming recurring issues into automated detection and repair processes.

β€’ Establish validation and handoff criteria to ensure that new capacities are safely and consistently integrated into production.

β€’ Participate in on-call responsibilities, incident response, root-cause analysis, and follow-up actions to implement lasting solutions.

β€’ Collaborate with hardware, networking, platform, data center operations, and partner teams to resolve issues that cross ownership boundaries.


⛳️ Requirements

β€’ Over 8 years of experience in building software for or operating production infrastructure, with significant hands-on bare-metal expertise.

β€’ Proficient in Go or Python, with a proven track record of delivering production automation and services.

β€’ Direct experience with BMC and Redfish for server provisioning, health inspection, power management, or fault diagnosis.

β€’ Practical experience with NVIDIA GPU hardware, including NVL72 systems and BlueField-3 or newer DPUs.

β€’ Familiarity with Linux, firmware and driver management, network boot processes, and the server lifecycle from initial provisioning to repair.

β€’ Experience in managing production reliability through on-call responsibilities, incident response, observability, and sustainable solutions.

β€’ Ability to troubleshoot failures across hardware, host operating systems, networking, and distributed services.

β€’ Strong communication skills and proven ownership of issues that involve multiple teams.

β€’ BS/MS in Computer Science or equivalent practical experience.

β€’ Experience operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle debugging, with equivalent DPU experience considered.

β€’ Background in NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation.

β€’ Experience in creating safe, repeatable workflows for rack-scale bringup, firmware upgrades, hardware replacements, and customer handoffs.

β€’ Familiarity with Kubernetes, GitOps, Argo CD, SLOs, and fleet-wide automation.


🏝️ Benefits

β€’ Equity

β€’ Benefits

People also viewed

Prime Intellect3 days ago

Technical Staff Member – Production Engineering

US flagCalifornia OnlyFull-timeProduction Engineer$150k – $300k/year
ApplyView job
NVIDIAOct 10

Software Engineer, SRE, Production Engineering – DGX Cloud

US flagCalifornia, +5 more statesFull-timeProduction Engineer$184k – $287.5k/year
ApplyView job
NVIDIAOct 6

Senior Production Engineer – DGX Cloud

CH flagSwitzerland OnlyFull-timeProduction Engineer
ApplyView job
GitLabOct 6

Senior Backend Engineer, Ruby – Production Engineering

PL flagPoland OnlyFull-timeProduction EngineerPLN 272k – PLN 408k/year
ApplyView job
NVIDIAOct 3

Senior Production Engineer – DGX Cloud

US flagCalifornia OnlyFull-timeProduction Engineer$184k – $356.5k/year
ApplyView job
NVIDIASep 30

Senior Software Engineer, SRE, Production Engineering

US flagCalifornia OnlyFull-timeProduction Engineer$152k – $287.5k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers