AI Infrastructure Engineer

atvClusterRemoteFull-timeInfrastructure EngineerMid-levelSenior€90k – €105k/year

Posted Oct 6

This is a fully remote position, open to applicants in Germany, +1 more country.

📋 Description

• Lead comprehensive technical deployments for GPU neocloud and AI Factory clients, from bare metal setup to validated vCluster environments.

• Configure and troubleshoot bare metal GPU node infrastructure, which includes CNI configuration, GPU Operator installation, distributed storage backends, and RDMA/InfiniBand.

• Deploy and validate Kubernetes and vCluster for GPU-enabled managed Kubernetes.

• Collaborate with customer teams to foster operational self-sufficiency.

• Create documentation for reusable playbooks and deployment architectures.

• Work alongside Engineering and Product teams to highlight infrastructure challenges and contribute to the roadmap.

• Partner with Sales in pre-sales proof-of-value initiatives that necessitate deep infrastructure expertise.


⛳️ Requirements

• Over 5 years of experience in deploying and managing Kubernetes in production environments, preferably on bare metal or in complex settings.

• Hands-on knowledge of NVIDIA GPU Operators, CUDA tools, and systems-level configuration for GPU nodes.

• Profound understanding of CNI plugins, overlay networks, load balancing, and connectivity troubleshooting in layered environments.

• Experience with persistent volume configuration, CSI drivers, and distributed systems such as Ceph, Rook, Weka, or Longhorn.

• Ability to operate effectively in fast-paced, ambiguous environments.

• Preference for utilizing modern technology stacks and addressing challenges from pipelines to internal services.

• Proficiency in writing automation scripts using Bash, Python, or Go.

• Relevant certifications like CKA or experience in developing Kubernetes Operators.

• Familiarity with inference serving, GPU scheduling, and LLM deployment tools.

• Experience in creating AI Automation documentation and contributing to a communal knowledge base.


🏝️ Benefits

• Competitive compensation package, which includes equity.

• Health, dental, vision, and life insurance for you and your eligible dependents (benefits may vary by country).

• Flexible working hours.

• Workplace flexibility.

• Remote-first culture.

People also viewed

FUJIFILM Corporation1 day ago

Principal Cloud Infrastructure Engineer

US flagUnited States OnlyFull-timeInfrastructure Engineer$133k – $213k/year
ApplyView job
NVIDIA1 day ago

Senior AI Infrastructure Engineer – DGX Cloud

US flagUnited States OnlyFull-timeInfrastructure Engineer$152k – $287.5k/year
ApplyView job
Vultr2 days ago

Infrastructure Operations Engineer

US flagUnited States OnlyFull-timeInfrastructure Engineer$75k – $95k/year
ApplyView job
That's No Moon2 days ago

Infrastructure Engineer

US flagCalifornia OnlyFull-timeInfrastructure Engineer$100k – $135k/year
ApplyView job
Cohere2 days ago

Adoption Specialist – Infrastructure, Agentic

CA flagCanada OnlyFull-timeInfrastructure EngineerC$290k – C$330k/year
ApplyView job
StackAdapt2 days ago

Staff Infrastructure Engineer, Cost Optimization

CA flagCanada, +1 more countryFull-timeInfrastructure Engineer$182.4k – $250.8k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers