Datacenter Infrastructure Specialist

This is a fully remote position, open to applicants in United States.

📋 Description

• Validate new hardware and ensure that partner deployments adhere to Runpod specifications for distributed AI/ML workloads.

• Monitor fleet health and detect any performance degradation.

• Conduct audits on downtime and provide the necessary technical data to safeguard customer SLAs.

• Utilize LLMs and AI agents to automate network triage and create dynamic fleet runbooks.

• Coordinate technical incident communications and convert outages into actionable resolutions.

• Support the expansion of infrastructure partners.

• Manage the technical lifecycle and operational integrity of Runpod’s high-density GPU fleet.

• Act as an infrastructure advisor, technical translator, adopter, and incident commander for hardware partners.

• Connect hardware partners with internal engineering teams.

⛳️ Requirements

• 3–5 years of experience in infrastructure operations, systems reliability, or datacenter engineering.

• Strong expertise in standard datacenter networking and performance troubleshooting.

• Familiarity with RDMA, InfiniBand, or RoCE is highly preferred.

• Hands-on experience with the NVIDIA Software Stack, including driver installation and performance utilities.

• Knowledge of multi-node performance tuning.

• Solid skills in Linux system administration.

• Experience with containerization using Docker.

• System-level troubleshooting and performance tuning at the kernel and hardware interface layers.

• Excellent written and verbal communication skills.

• Ability to convey hardware or networking issues to technical partners and internal leadership.

• Willingness to participate in a future on-call rotation.

• Experience in a fast-paced startup environment is preferred.

• Experience managing or optimizing bare-metal HPC environments at a large scale is preferred.

• Familiarity with Grafana, Prometheus, or Datadog is preferred.

• Proficiency in Python, Go (Golang), or Bash is preferred.

• Must be eligible to work in the United States; Runpod is currently unable to sponsor employment visas.

🏝️ Benefits

• Meaningful equity; every team member receives stock options.

• Comprehensive medical, dental & vision plans; 100% coverage for employees and partial coverage for dependents.

• Flexible PTO.

• Remote-first work environment with inclusive, collaborative teams.

• $1,200 Home Office & Equipment Stipend.

• Opportunities for culture, learning, and ownership.