Principal Software Engineer, DGX Cloud Production Engineering

This is a fully remote position, open to applicants in California.

📋 Description

• Develop and implement the technical strategy for DGX Cloud cluster operations, creating the necessary automation, GitOps, and Day 2 reliability to manage large-scale GPU clusters across NVIDIA Cloud Partners (NCPs) and on-premises environments.

• Oversee the design and execution of systems for cluster lifecycle management, validation, repair, upgrades, observability, and overall readiness.

• Create standardized patterns for Kubernetes-based GPU cluster operations across both partner and on-premises environments.

• Recognize and reduce operational inefficiencies through software, APIs, automation, and agent-assisted workflows.

• Establish technical benchmarks for production readiness, service level objectives (SLOs), incident response protocols, handoff gates, and operational acceptance criteria.

• Guide and mentor engineers while influencing platform, infrastructure, storage, networking, security, and workload teams.

⛳️ Requirements

• Over 15 years of experience in building and managing large-scale distributed systems or cloud infrastructure.

• Extensive expertise in Kubernetes, Linux, infrastructure automation, and production operations.

• Proficient programming skills in Go, Python, or a comparable language.

• Demonstrated capability to lead intricate cross-organizational technical projects.

• Experience in designing dependable systems with clearly defined SLOs, observability, incident response, and automation strategies.

• BS/MS in Computer Science or equivalent practical experience.

🏝️ Benefits

• Equity

• Benefits