
AI Infrastructure Solutions Architect
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in California.
• Design large-scale enterprise infrastructure environments that support workloads in AI, machine learning, and high-performance computing.
• Develop architectures that integrate GPU compute platforms, high-throughput networking, enterprise storage, and workload orchestration technologies.
• Assess infrastructure requirements by analyzing performance, scalability, resource utilization, and operational costs.
• Create technical architecture documentation, infrastructure diagrams, hardware specifications, and implementation plans.
• Facilitate infrastructure discovery sessions and technical workshops to gather customer requirements and propose suitable solutions.
• Design on-premises, private cloud, and hybrid AI computing environments.
• Evaluate data center infrastructure and suggest enhancements for GPU-intensive computing.
• Architect NVIDIA and alternative GPU platforms, including scalable GPU clusters.
• Assist with GPU sizing, performance analysis, capacity planning, and infrastructure optimization.
• Develop high-bandwidth networking architectures utilizing InfiniBand, RoCE, and high-speed Ethernet.
• Integrate high-performance storage solutions for extensive data processing and model training.
• Design platforms that support containerized AI applications and distributed workloads using Kubernetes, Red Hat OpenShift AI, and Linux.
• Assess GPU workload management platforms, such as NVIDIA Run:ai and Slurm.
• Offer guidance on NVIDIA AI Enterprise, NVIDIA NIM, NVIDIA Mission Control, and related software.
• Support MLOps platform integration for model development, training, deployment, monitoring, and lifecycle management.
• Formulate infrastructure automation strategies.
• Incorporate security, identity management, access control, monitoring, logging, observability, auditability, and resilience into architectures.
• Advise clients throughout discovery, solution planning, and architecture engagements.
• Translate both business and technical requirements into infrastructure recommendations.
• Collaborate with technical sales and delivery teams on solution designs, equipment requirements, implementation strategies, and cost estimates.
• Present architectures to technical teams, IT leadership, and executive stakeholders.
• Assess competing technologies based on performance, cost, and business needs.
• Develop reusable documentation, architecture standards, and solution frameworks.
• Provide technical leadership and mentorship to infrastructure engineers and architects.
• Stay informed about emerging AI infrastructure technologies and architectural practices.
• Over 10 years of experience in enterprise infrastructure architecture, solutions engineering, technical consulting, or related fields.
• Extensive experience in designing complex data center or high-performance computing environments.
• In-depth knowledge of NVIDIA GPU computing technologies and enterprise AI infrastructure.
• Experience with accelerated computing platforms, GPU cluster architecture, and infrastructure sizing.
• Advanced understanding of enterprise networking, including high-speed Ethernet, InfiniBand, or RoCE.
• Experience designing enterprise storage architectures for high-throughput and performance-sensitive applications.
• Strong knowledge of Linux operating systems, virtualization, containerization, and Kubernetes.
• Familiarity with AI infrastructure software, GPU orchestration, and workload scheduling technologies.
• Proven ability to produce high-level designs, detailed technical specifications, and infrastructure implementation documentation.
• Demonstrated capability to lead customer-facing technical discussions and convey complex solutions to senior stakeholders.
• Strong understanding of infrastructure scalability, availability, performance, and security principles.
• Ability to work collaboratively across compute, storage, networking, security, and application engineering teams.
• Preferred: Experience with NVIDIA DGX, HGX, MGX, or similar accelerated computing platforms.
• Preferred: Familiarity with NVIDIA AI Enterprise, NIM, Run:ai, Mission Control, and related technologies.
• Preferred: Experience with AMD Instinct GPU platforms or other accelerator architectures.
• Preferred: Knowledge of distributed AI training, inference optimization, and infrastructure requirements for large language models.
• Preferred: Experience with Red Hat OpenShift AI or other enterprise Kubernetes environments.
• Preferred: Familiarity with Slurm and GPU resource scheduling platforms.
• Preferred: Experience supporting enterprise AI infrastructure deployments in regulated environments.
• Preferred: Understanding of NIST, FedRAMP, CMMC, or similar security frameworks.
• Preferred: Experience with GPU-dense data center infrastructure, including power and cooling considerations.
• Preferred: Experience with Python scripting or infrastructure automation.
• Preferred: Relevant certifications in NVIDIA, cloud architecture, Linux, Kubernetes, or enterprise infrastructure.
• Preferred: Experience in supporting technical pre-sales engagements, solution development, or enterprise consulting initiatives.
• Competitive salary and benefits package for all full-time employees.
• Work-life balance.
• Positive company culture.
• Emphasis on teamwork, integrity, accountability, and diversity.
Ricoh UK
Keenfinity Group
Code Metal
Ramp
Get handpicked remote jobs straight to your inbox weekly.