
Director of Cloud Operations
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Texas.
• Oversee operational delivery for US neocloud clients, focusing on availability, SLAs, incident and problem management, and change control.
• Lead and nurture the US operations team, comprising engineers, NOC/SRE personnel, and site-level coordinators.
• Establish hiring strategies, on-call frameworks, and performance benchmarks.
• Manage GPU cluster operations, covering health monitoring, firmware and driver lifecycle, fabric and storage performance, node replacement, and capacity planning.
• Serve as the escalation point for leadership during major incidents and facilitate communication with customer executives.
• Create runbooks, handover procedures, and operational models in collaboration with customer data center and engineering teams.
• Collaborate with Sales, Solutions Engineering, and Product to outline operational services, support pricing, and mitigate delivery risks prior to contract finalization.
• Define and track operational KPIs, including uptime, MTTR, ticket aging, GPU utilization, and SLA achievement.
• Manage relationships with hardware, networking, and data center providers.
• Enhance operations through automation, standardized tools, and a unified operational perspective across sites.
• Coordinate with European and APAC operations teams to ensure follow-the-sun coverage and uniform practices.
• Over 10 years of experience in infrastructure or cloud operations.
• More than 5 years of experience leading technical teams.
• At least 2 years of experience managing managers or overseeing multi-site teams.
• Proven experience managing teams that operate AI/GPU infrastructure at scale, including NVIDIA H100/H200/GB200-class or equivalent.
• Familiarity with InfiniBand or RoCE fabrics, DCGM, and Kubernetes or Slurm scheduler/orchestration layers.
• Strong foundation in Linux, networking, storage, virtualization, bare-metal provisioning, and power and cooling principles.
• Production experience with Kubernetes, observability, GitOps, and infrastructure as code tools.
• Demonstrated history of running a NOC or SRE function with established SLAs, on-call rotations, and structured incident management (ITIL or equivalent).
• Experience working directly with customers or tenants during incidents, including at the executive level.
• Capability to interpret and challenge technical designs and communicate operational trade-offs to non-technical stakeholders.
• Preferred: experience at a neocloud, GPU cloud, hyperscaler, colocation, or managed services provider.
• Preferred: familiarity with Metal3, MAAS, Ironic, or similar bare-metal lifecycle tools and multi-tenant GPU platforms.
• Preferred: experience in developing or scoping managed-service offerings, including SLAs and pricing frameworks.
• Preferred: experience with Prometheus, Grafana, VictoriaMetrics, OpenTelemetry, or similar observability stacks.
• Preferred: CKA/CKAD, ITIL 4, or relevant NVIDIA certifications.
• Competitive compensation package accompanied by a robust benefits plan.
• Collaborate with exceptionally passionate, skilled, and engaging colleagues.
• Contribute to pioneering, open-source innovations.
• Thrive in a high-energy environment that values openness, collaboration, risk-taking, and continuous growth.
Jobrack
Dane Street
BetterHelp
Get handpicked remote jobs straight to your inbox weekly.