Senior Platform Engineer

This is a fully remote position, open to applicants in United States, +2 more locations.

📋 Description

• Design and develop scalable infrastructure to support LLM and GenAI workloads in multi-GPU settings.

• Conduct GPU profiling, benchmarking, and performance enhancements for distributed training tasks.

• Administer and schedule compute-heavy jobs utilizing Slurm-based clusters and OpenShift/Kubernetes platforms.

• Enable and optimize the NVIDIA GPU stack, including CUDA, cuDNN, NCCL, Triton, and RAPIDS.

• Work collaboratively with cross-functional teams to deploy models in both research and production settings.

• Construct and maintain GenAI pipelines, including fine-tuning, RAG, multi-modal inferencing, and LLMOps.

• Create reusable infrastructure templates using tools such as Terraform and Helm.

• Contribute to internal innovation efforts, including PoCs and workshops, while supporting client-facing delivery engagements.

⛳️ Requirements

• Over 10 years of experience in relevant fields.

• Extensive experience with Slurm and distributed training environments.

• Proficient hands-on experience with Red Hat OpenShift and/or Kubernetes.

• In-depth knowledge of the NVIDIA GPU ecosystem, including CUDA, cuDNN, NCCL, Nsight, Triton/TensorRT.

• Strong foundation in Linux systems, performance tuning, and optimization for multi-GPU setups.

• Proven experience in deploying GenAI workloads, such as LLM fine-tuning, RAG pipelines, and multi-modal systems.

• Familiarity with Infrastructure-as-Code tools like Terraform and Ansible.

• Experience with cloud GPU environments including GCP, Azure, AWS, OCI, and/or on-premises GPU clusters.

• Experience with NVIDIA NIMs, DGX systems, or GPU-accelerated containers is a plus.

• Knowledge of LLMOps frameworks and MLOps integration is advantageous.

• Familiarity with vector databases and retrieval systems used for RAG architectures is a plus.

• Comfortable working in client-facing roles and collaborating with AI solution teams is a plus.

🏝️ Benefits

• Make a significant impact at one of the world's fastest-growing AI-first digital engineering firms.

• Enhance your skills and discover your potential while tackling complex challenges in advanced technological fields alongside passionate and talented colleagues.

• Experience innovation firsthand by collaborating with disruptive innovators in a research-driven organization with over 60 patents filed across various disciplines.

• Stay ahead of industry trends, immerse yourself in groundbreaking AI, ML, data, and cloud technologies, and gain valuable experience working with Fortune 500 companies.

• Enjoy ample opportunities to learn, grow, and engage with colleagues from diverse backgrounds and experiences around the world.