
Senior AI Platform Engineer
Posted Nov 13

Posted Nov 13
This is a fully remote position, open to applicants in Kentucky.
• Design, implement, and oversee on-premises and hybrid AI infrastructure, including environments utilizing NVIDIA GPUs and NVIDIA AI Enterprise.
• Deploy, enhance, and manage locally hosted large language models (LLMs) and inference services using tools such as NVIDIA NIM, vLLM, Ollama, or similar technologies.
• Develop secure APIs and services that connect approved AI functionalities to University applications and end-users.
• Monitor system performance, optimize GPU resources, resolve issues, and ensure security, reliability, and scalability.
• Utilize Linux, containerization, scripting, and platform engineering methodologies to improve operational efficiency.
• Collaborate with IT and the AI Lab to assess emerging technologies and impact platform architecture.
• Extensive professional experience in platform engineering, DevOps, systems engineering, or enterprise infrastructure.
• Proven track record of deploying and supporting production AI/ML environments.
• Practical experience in deploying or managing NVIDIA GPU-based AI infrastructure, NVIDIA AI Enterprise, NVIDIA NIM, or similar AI/ML and enterprise inference platforms.
• Strong understanding of Linux, networking, containers, and modern infrastructure practices.
• Experience in scripting and automation using Python, Bash, or comparable tools.
• Familiarity with APIs, authentication, security measures, and monitoring techniques.
• Bachelor’s degree in a relevant technical discipline or equivalent professional experience.
• Direct experience with NVIDIA AI Enterprise and NVIDIA NIM; knowledge of CUDA or GPU performance optimization.
• Familiarity with vLLM, Ollama, Hugging Face, Docker, Kubernetes, infrastructure as code, or CI/CD practices.
• Understanding of MLOps/LLMOps, vector databases, embeddings, or retrieval-augmented generation (RAG).
• Experience with enterprise API gateways, hybrid cloud solutions, higher education, or research computing environments.
• Opportunity to design and develop a new enterprise AI platform.
• Hands-on experience with NVIDIA GPU computing, enterprise AI software, and open-weight language models.
• Chance to contribute to teaching, learning, research, and institutional innovation.
• Influence over tool selection, technical standards, and enhancements to the platform.
RTX
CSAA Insurance Group, a AAA Insurer
Supabase
Get handpicked remote jobs straight to your inbox weekly.