Senior Platform Engineer

This is a fully remote position, open to applicants in New Jersey, +1 more state.

📋 Description

• Design and establish scalable infrastructure for LLM and GenAI workloads across multi-GPU setups.

• Conduct GPU profiling, benchmarking, and performance enhancements for distributed training tasks.

• Oversee and schedule compute-intensive operations utilizing Slurm-based clusters and OpenShift/Kubernetes environments.

• Optimize and enable the NVIDIA GPU stack, encompassing CUDA, cuDNN, NCCL, Triton, and RAPIDS.

• Work collaboratively with cross-functional teams to implement models in both research and production settings.

• Create and maintain GenAI pipelines, including fine-tuning, RAG, multimodal inferencing, and LLMOps.

• Develop reusable infrastructure templates utilizing Terraform and Helm.

• Contribute to internal innovation through proofs of concept and workshops.

• Assist in client-facing delivery engagements.

⛳️ Requirements

• Minimum of 5 years of experience.

• Extensive experience with Slurm and distributed training environments.

• Practical expertise with Red Hat OpenShift and/or Kubernetes.

• In-depth knowledge of the NVIDIA GPU ecosystem, including CUDA, cuDNN, NCCL, Nsight, Triton/TensorRT.

• Strong foundation in Linux systems, performance tuning, and multi-GPU optimization.

• Proven experience in deploying GenAI workloads, including LLM fine-tuning, RAG pipelines, and multimodal systems.

• Familiarity with Infrastructure-as-Code tools such as Terraform and Ansible.

• Experience with cloud GPU environments including GCP, Azure, AWS, OCI and/or on-premises GPU clusters.

• Experience with NVIDIA NIMs, DGX systems, or GPU-accelerated containers.

• Understanding of LLMOps frameworks and MLOps integration.

• Familiarity with vector databases and retrieval systems for RAG architectures.

• Comfortable working in client-facing settings and collaborating with AI solution teams.

• Experience in the healthcare domain is a plus, including FHIR R4, HL7 v2, SMART on FHIR, EHR integrations, HIPAA, CDS Hooks, clinical workflows, and clinical decision support systems.

🏝️ Benefits

• Opportunities for upskilling and professional development.

• Exposure to AI, ML, data, and cloud technologies.

• Chance to collaborate with Fortune 500 companies.

• Research-driven organization with over 60 patents filed.

• Work alongside talented colleagues from around the world.

• Hybrid work culture.