
Senior Software Engineer, Resilience Engineering – DGX Cloud
Posted Nov 13

Posted Nov 13
This is a fully remote position, open to applicants in California.
• Develop a comprehensive reliability strategy for NVIDIA's round-the-clock operational environment.
• Create and uphold a stringent SLO program across various teams.
• Direct the incident response efforts for critical incidents.
• Enhance and refine production code for the data platform and associated tools.
• Execute chaos engineering, failure injection, and resilience testing methodologies.
• Elevate operational standards through direct experience and leadership.
• Extensive, hands-on experience managing large-scale production systems with a demonstrated success record.
• In-depth knowledge of failure modes in expansive systems, including cascading dependencies and retry storms.
• Strong software engineering capabilities with current, hands-on expertise in Go, Python, or comparable languages.
• Established experience in developing and sustaining an SLO program with operational integrity.
• Practical background in chaos engineering and failure injection techniques.
• Ability to exert influence across team boundaries through established credibility and expertise.
• Over 10 years of industry experience.
• Bachelor's or Master's degree, or equivalent experience managing systems at scale.
• Experience in a premier reliability function such as Google SRE or Meta production engineering.
• Proficient in operating GPU, HPC, or AI training infrastructure.
• Proven track record of delivering measurable reliability enhancements.
• Familiarity with tools like Prometheus, OpenTelemetry, Grafana, PagerDuty, and Rootly.
• Highly competitive salaries.
• Comprehensive benefits package.
• Equity.
Helpware
Introhive
Boeing
M9 Solutions
Get handpicked remote jobs straight to your inbox weekly.