Infrastructure Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Design, size, provision, and manage bare-metal GPU server fleets in both on-prem and air-gapped environments, handling firmware/BIOS, BMC via Redfish/IPMI, OS, and drivers, all while implementing zero-touch provisioning (PXE/iPXE, MAAS/Metal3/Tinkerbell) and automation tools (Ansible/Salt, Terraform/Pulumi).

• Take full ownership of the NVIDIA GPU stack from start to finish: including drivers, CUDA, GPU Operator, Container Toolkit, MIG, and DCGM, optimized for inference throughput, latency, and utilization.

• Construct the bare-metal foundation for Kubernetes, focusing on node lifecycle, container runtime, GPU device plugins, node feature discovery, and kernel/NUMA optimization.

• Design data-center networking and resilient storage solutions (VLANs/switching, RDMA, Ceph/ZFS/NVMe) that can scale without the need to replace the core, ensuring encryption at rest.

• Collaborate with ML and MLOps teams on on-prem inference serving (Triton, KServe, vLLM), addressing model deployment, GPU scheduling and sharing, along with performance optimization.

• Plan and execute on-site build-outs, including rack integration, power/UPS and cooling sizing, commissioning, capacity planning, runbooks, and handover to operators.

⛳️ Requirements

• A minimum of 5 years of experience in bare-metal, HPC/GPU, data-center, or systems infrastructure engineering, with direct hands-on responsibility for physical and compute infrastructure.

• Proficient in bare-metal Linux (RHEL/Rocky/Ubuntu) with skills in firmware, BMC, PXE, kernel and storage tuning, coupled with a strong grasp of networking and storage fundamentals.

• Practical experience with the NVIDIA GPU stack (drivers, CUDA, GPU Operator, MIG, DCGM) and deploying GPU models in a production environment.

• Ability to work comfortably in air-gapped or on-prem environments and willingness to travel to customer locations for builds and deployments.

• Detail-oriented, methodical, and composed during hardware incidents, with eligibility to work in Germany.

🏝️ Benefits

• Modern architecture & stack.

• Remote-first work environment in Germany with occasional team gatherings in Berlin.

• Home office budget and high-quality equipment.

• 30 days of vacation.

• Opportunity to make a direct impact on critical missions for both private and public sector clients.