Cloud Services Software Engineer

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• Design and enhance AI infrastructure services for DGX Cloud.

• Create solutions that blend machine learning, distributed systems, and high-performance computing.

• Architect, develop, and optimize microservices managed by Kubernetes for extensive AI training workflows on advanced AI training supercomputers offered by leading cloud service providers.

• Collaborate in the design and implementation of APIs that connect services with NVIDIA's resiliency stacks, which include telemetry, break/fix automation, checkpoint, and execution systems.

• Develop a submission abstraction for long-duration training jobs, addressing infrastructure failures, automated restarts, job lifecycles, efficiency, and user notifications.

• Construct modular services that can be deployed on on-premises AI clusters utilizing NVIDIA hardware and cloud services.

• Improve the infrastructure and products that support NVIDIA's AI platforms.

⛳️ Requirements

• A Bachelor’s degree or higher in Computer Science or a related technical field (or equivalent experience).

• Over 5 years of practical experience in backend development, ideally with Python, Go, C/C++, or other high-performance programming languages.

• Proven history of building and scaling large distributed systems.

• Experience with cloud computing platforms such as AWS, Azure, and GCP.

• Familiarity with container technologies including Docker and Kubernetes.

• Background in HPC/AI platforms like Slurm.

• Real-world experience with deep learning frameworks and orchestrators such as PyTorch, TensorFlow, JAX, and Ray.

• Experience in creating a framework plugin architecture that facilitates integration with the cluster scheduler in a user-visible manner.

• Solid understanding of NVIDIA GPUs, networking technologies, and their failure patterns.

• Familiarity with AI models and AI-based tools.

• Provide references to your code contributions.

🏝️ Benefits

• Equity.

• Comprehensive benefits.