Senior AI Infrastructure Software Engineer – DGX Cloud

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• Create platforms and tools for extensive AI, LLM, and GenAI infrastructure.

• Design and enhance tools to boost the efficiency and resilience of AI/ML workloads.

• Diagnose, analyze, and resolve failures from the application level to the hardware level.

• Improve the infrastructure and products that support NVIDIA's AI platforms.

• Collaborate in designing and implementing APIs for integration with NVIDIA's resiliency stacks on the platform.

• Establish meaningful and actionable reliability metrics to monitor and enhance system and service reliability.

• Construct and expand distributed systems and AI infrastructure services.

• Facilitate large-scale AI training, inference, fine-tuning, and Agentic AI in a production environment.

⛳️ Requirements

• A minimum of 8+ years of experience in developing software infrastructure for large-scale AI systems.

• A Bachelor's degree or higher in Computer Science or a related technical field, or equivalent experience.

• Strong debugging abilities and experience in analyzing and addressing AI applications from both application and hardware levels.

• A proven history of building and scaling large distributed systems.

• Experience in AI training, inference, and data infrastructure services.

• Familiarity with Kubernetes.

• Experience managing large-scale observability platforms for monitoring and logging, such as ELK, Prometheus, and Loki.

• Proficiency in Golang, Python, C/C++, and scripting languages.

• Excellent communication and collaboration skills.

• Experience working with large-scale AI clusters and cloud-native infrastructure.

• A strong understanding of NVIDIA GPUs and networking technologies including RDMA, IB, and NCCL.

• Knowledge of deep learning frameworks such as PyTorch, TensorFlow, JAX, Dynamo, and Ray.

• Experience performing root-cause analysis of failures at the datacenter scale.

• A solid background in software design and development.

🏝️ Benefits

• Equity.

• Comprehensive benefits.

• Support and mentorship.

• A culture of blameless postmortems, iterative improvement, and risk-taking.

• An inclusive work environment.

• An equal opportunity employer.