AI Infrastructure Solutions Architect

Posted 3 days ago

This is a fully remote position, open to applicants in California.

📋 Description

• Design large-scale enterprise infrastructure environments that support workloads in AI, machine learning, and high-performance computing.

• Develop architectures that integrate GPU compute platforms, high-throughput networking, enterprise storage, and workload orchestration technologies.

• Assess infrastructure requirements by analyzing performance, scalability, resource utilization, and operational costs.

• Create technical architecture documentation, infrastructure diagrams, hardware specifications, and implementation plans.

• Facilitate infrastructure discovery sessions and technical workshops to gather customer requirements and propose suitable solutions.

• Design on-premises, private cloud, and hybrid AI computing environments.

• Evaluate data center infrastructure and suggest enhancements for GPU-intensive computing.

• Architect NVIDIA and alternative GPU platforms, including scalable GPU clusters.

• Assist with GPU sizing, performance analysis, capacity planning, and infrastructure optimization.

• Develop high-bandwidth networking architectures utilizing InfiniBand, RoCE, and high-speed Ethernet.

• Integrate high-performance storage solutions for extensive data processing and model training.

• Design platforms that support containerized AI applications and distributed workloads using Kubernetes, Red Hat OpenShift AI, and Linux.

• Assess GPU workload management platforms, such as NVIDIA Run:ai and Slurm.

• Offer guidance on NVIDIA AI Enterprise, NVIDIA NIM, NVIDIA Mission Control, and related software.

• Support MLOps platform integration for model development, training, deployment, monitoring, and lifecycle management.

• Formulate infrastructure automation strategies.

• Incorporate security, identity management, access control, monitoring, logging, observability, auditability, and resilience into architectures.

• Advise clients throughout discovery, solution planning, and architecture engagements.

• Translate both business and technical requirements into infrastructure recommendations.

• Collaborate with technical sales and delivery teams on solution designs, equipment requirements, implementation strategies, and cost estimates.

• Present architectures to technical teams, IT leadership, and executive stakeholders.

• Assess competing technologies based on performance, cost, and business needs.

• Develop reusable documentation, architecture standards, and solution frameworks.

• Provide technical leadership and mentorship to infrastructure engineers and architects.

• Stay informed about emerging AI infrastructure technologies and architectural practices.


⛳️ Requirements

• Over 10 years of experience in enterprise infrastructure architecture, solutions engineering, technical consulting, or related fields.

• Extensive experience in designing complex data center or high-performance computing environments.

• In-depth knowledge of NVIDIA GPU computing technologies and enterprise AI infrastructure.

• Experience with accelerated computing platforms, GPU cluster architecture, and infrastructure sizing.

• Advanced understanding of enterprise networking, including high-speed Ethernet, InfiniBand, or RoCE.

• Experience designing enterprise storage architectures for high-throughput and performance-sensitive applications.

• Strong knowledge of Linux operating systems, virtualization, containerization, and Kubernetes.

• Familiarity with AI infrastructure software, GPU orchestration, and workload scheduling technologies.

• Proven ability to produce high-level designs, detailed technical specifications, and infrastructure implementation documentation.

• Demonstrated capability to lead customer-facing technical discussions and convey complex solutions to senior stakeholders.

• Strong understanding of infrastructure scalability, availability, performance, and security principles.

• Ability to work collaboratively across compute, storage, networking, security, and application engineering teams.

• Preferred: Experience with NVIDIA DGX, HGX, MGX, or similar accelerated computing platforms.

• Preferred: Familiarity with NVIDIA AI Enterprise, NIM, Run:ai, Mission Control, and related technologies.

• Preferred: Experience with AMD Instinct GPU platforms or other accelerator architectures.

• Preferred: Knowledge of distributed AI training, inference optimization, and infrastructure requirements for large language models.

• Preferred: Experience with Red Hat OpenShift AI or other enterprise Kubernetes environments.

• Preferred: Familiarity with Slurm and GPU resource scheduling platforms.

• Preferred: Experience supporting enterprise AI infrastructure deployments in regulated environments.

• Preferred: Understanding of NIST, FedRAMP, CMMC, or similar security frameworks.

• Preferred: Experience with GPU-dense data center infrastructure, including power and cooling considerations.

• Preferred: Experience with Python scripting or infrastructure automation.

• Preferred: Relevant certifications in NVIDIA, cloud architecture, Linux, Kubernetes, or enterprise infrastructure.

• Preferred: Experience in supporting technical pre-sales engagements, solution development, or enterprise consulting initiatives.


🏝️ Benefits

• Competitive salary and benefits package for all full-time employees.

• Work-life balance.

• Positive company culture.

• Emphasis on teamwork, integrity, accountability, and diversity.

People also viewed

Ricoh UK7 hours ago

Senior Solutions Engineer

US flagUnited States OnlyFull-timeSolutions Engineer$80.3k – $85k/year
ApplyView job
Keenfinity Group7 hours ago

Technical Solutions Engineer

US flagNew York OnlyFull-timeSolutions Engineer$100k – $115k/year
ApplyView job
Code Metal7 hours ago

Solutions Architect, Financial Services

US flagUnited States OnlyFull-timeSolutions Engineer$214k – $290k/year
ApplyView job
Ramp7 hours ago

Solutions Consultant, Post Sales, Strategic

US flagUnited States OnlyFull-timeSolutions Engineer
ApplyView job
Temporal Technologies7 hours ago

Staff Solutions Architect, Digital Native

US flagUnited States OnlyFull-timeSolutions Engineer$168k – $220k/year
ApplyView job
Wavestone7 hours ago

Senior AI Solutions Consultant

RO flagRomania OnlyFull-timeSolutions Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers