AI Infrastructure Consulting Engineer – Orchestration & Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee time and expenses to align with or surpass Statement of Work (SOW) expectations, while raising any concerns regarding scope, schedule, or budget.

• Implement and configure AI workload orchestration, scheduling, resource governance, and platform services in customer environments.

• Deploy and integrate Kubernetes, Run:ai, ClearML, Slurm, NVIDIA software components, container registries, observability solutions, and additional supporting platform services.

• Conduct platform discovery, installation, configuration, validation, upgrades, troubleshooting, and transfer of knowledge to clients.

• Collaborate with teams in security, networking, compute, storage, applications, and data to address cross-platform dependencies.

• Provide technical insights for SOWs, ROMs, LOEs, implementation strategies, and solution validation.

• Develop and maintain project documentation, including as-built configurations, test plans, work logs, and materials for client handoff.

⛳️ Requirements

• Bachelor’s degree and 3 years of experience in delivering complex platform, infrastructure, or cloud-native solutions, encompassing planning, implementation, integration, and support, or 7 years of experience in delivering such solutions.

• Practical experience administering Kubernetes or enterprise Kubernetes distributions within production or customer environments.

• Familiarity with containers, registries, Helm, operators, storage classes, ingress, identity integration, secrets, and role-based access control.

• Knowledge of GPU scheduling, quotas, tenancy, resource allocation, job lifecycle, and utilization concepts within AI environments.

• Experience with workload platforms such as Run:ai, ClearML, Slurm, NVIDIA Base Command, or similar technologies.

• Proficient in Linux, scripting, APIs, Git-based workflows, and infrastructure automation.

• Capability to create and implement execution and test plans that align with project deliverables and the Statement of Work.

• Excellent written and verbal communication skills for engaging with leadership stakeholders and clients.

• Demonstrated ability to produce technical documentation and transfer knowledge to administrators and platform users.

• Strong attention to detail, analytical problem-solving skills, and the ability to manage competing priorities while meeting deadlines.

• Willingness to work beyond standard shifts, on select weekends, or overtime as required.

• Readiness to travel as necessary to CDW locations or client sites.

• Valid U.S. driver’s license.

• Experience integrating Kubernetes with NVIDIA GPU Operator, Network Operator, device plugins, or NVIDIA AI Enterprise components is advantageous.

• Familiarity with platform observability, policy, security, identity, MLOps, CI/CD, and infrastructure-as-code tooling is a plus.

• Knowledge of Kubeflow, MLflow, Argo, GitOps, Prometheus, Grafana, or similar ecosystem tools is a plus.

• Relevant certifications in Kubernetes, NVIDIA, Linux, or automation are considered a plus.

🏝️ Benefits

• Annual bonus target subject to the terms and conditions of the plan.

• Overview of benefits provided by CDW.

• Flexible remote work arrangement.

• Opportunities for learning, growth, and professional development.

• A collaborative and supportive work environment.