Compute Solution Architect

This is a fully remote position, open to applicants in New York.

📋 Description

• Act as the main technical liaison for AI Infrastructure services.

• Diagnose and resolve various issues efficiently.

• Oversee the execution of strategic GPUaaS contracts, ensuring adherence to timelines, SLAs, and support commitments.

• Facilitate communication between product and support teams by conveying customer feedback and feature requests.

• Guarantee alignment with customer specifications.

• Assist customers in optimizing GPU performance for machine learning training and inference tasks.

• Ensure smooth integration and scalability of services.

• Collaborate with the sales team to uncover new opportunities and advocate for the latest products.

• Provide technical presentations to stakeholders.

• Coordinate efforts among customers, sales, product, and support teams throughout deployment and production phases.

• Verify that infrastructure operates as expected and that issues are promptly addressed.

⛳️ Requirements

• 5-10+ years of experience in positions such as Cloud Solutions Architect, Technical Account Manager, or Customer Engineer.

• Practical experience with cloud services and AI/ML workloads.

• Proven history as a technical pre-sales/solutions architect, managing infrastructure engagements with partners through to production.

• Strong grasp of AI/ML concepts and advanced implementations.

• Demonstrated success in driving technical engagement and adoption.

• Familiarity with cluster orchestration and scheduling tools such as Slurm, Kubernetes, and batch/HPC workload management.

• Preferred: experience with model training frameworks/runtimes including PyTorch, JAX, and TensorFlow.

• Preferred: knowledge of Generative AI serving runtimes like vLLM, TensorRT-LLM, SGLang, TGI, and LLM-D.

• Preferred: expertise with parallel file systems such as Lustre and GPFS, as well as object storage integration.

• Preferred: understanding of InfiniBand/RDMA networking, parallel storage, and multi-node distributed training architectures.

🏝️ Benefits

• Comprehensive healthcare coverage.

• Parental leave benefits.

• Retirement savings plans.

• Support for relocation.

• Access to wellness programs.

• Meal allowances provided.

• Transportation allowances available.

• Additional location-specific perks offered.