Senior AI Platform Engineer

Posted Nov 13

This is a fully remote position, open to applicants in Kentucky.

📋 Description

• Design, implement, and oversee on-premises and hybrid AI infrastructure, including environments utilizing NVIDIA GPUs and NVIDIA AI Enterprise.

• Deploy, enhance, and manage locally hosted large language models (LLMs) and inference services using tools such as NVIDIA NIM, vLLM, Ollama, or similar technologies.

• Develop secure APIs and services that connect approved AI functionalities to University applications and end-users.

• Monitor system performance, optimize GPU resources, resolve issues, and ensure security, reliability, and scalability.

• Utilize Linux, containerization, scripting, and platform engineering methodologies to improve operational efficiency.

• Collaborate with IT and the AI Lab to assess emerging technologies and impact platform architecture.


⛳️ Requirements

• Extensive professional experience in platform engineering, DevOps, systems engineering, or enterprise infrastructure.

• Proven track record of deploying and supporting production AI/ML environments.

• Practical experience in deploying or managing NVIDIA GPU-based AI infrastructure, NVIDIA AI Enterprise, NVIDIA NIM, or similar AI/ML and enterprise inference platforms.

• Strong understanding of Linux, networking, containers, and modern infrastructure practices.

• Experience in scripting and automation using Python, Bash, or comparable tools.

• Familiarity with APIs, authentication, security measures, and monitoring techniques.

• Bachelor’s degree in a relevant technical discipline or equivalent professional experience.

• Direct experience with NVIDIA AI Enterprise and NVIDIA NIM; knowledge of CUDA or GPU performance optimization.

• Familiarity with vLLM, Ollama, Hugging Face, Docker, Kubernetes, infrastructure as code, or CI/CD practices.

• Understanding of MLOps/LLMOps, vector databases, embeddings, or retrieval-augmented generation (RAG).

• Experience with enterprise API gateways, hybrid cloud solutions, higher education, or research computing environments.


🏝️ Benefits

• Opportunity to design and develop a new enterprise AI platform.

• Hands-on experience with NVIDIA GPU computing, enterprise AI software, and open-weight language models.

• Chance to contribute to teaching, learning, research, and institutional innovation.

• Influence over tool selection, technical standards, and enhancements to the platform.

People also viewed

RTX7 hours ago

Lead Platform Engineer

US flagConnecticut OnlyFull-timePlatform Engineer$132.4k – $251.6k/year
ApplyView job
ECP7 hours ago

Lead AI Engineer, Platform

US flagUnited States OnlyFull-timePlatform Engineer
ApplyView job
CSAA Insurance Group, a AAA Insurer7 hours ago

Senior Director, Platform Engineering

US flagUnited States OnlyFull-timePlatform Engineer
ApplyView job
Supabase7 hours ago

Storage Platform Engineer

Anywhere in the WorldFull-timePlatform Engineer
ApplyView job
Clarity Innovations, Inc.7 hours ago

Principal Platform Engineer

US flagUnited States OnlyFull-timePlatform Engineer$111.7k – $189.9k/year
ApplyView job
Avenga16 hours ago

Observability Platform Engineer

GB flagUnited Kingdom OnlyFull-timePlatform Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers