Senior Tech Architect – PE

This is a fully remote position, open to applicants in United States, +1 more state.

📋 Description

• Design and develop scalable infrastructure tailored for LLM and GenAI applications in multi-GPU settings.

• Conduct GPU profiling, benchmarking, and performance enhancements for distributed training tasks.

• Oversee and schedule compute-heavy jobs utilizing Slurm-based clusters alongside OpenShift/Kubernetes environments.

• Activate and optimize the NVIDIA GPU stack, which includes CUDA, cuDNN, NCCL, Triton, and RAPIDS.

• Collaborate with various teams to implement models in both research and production settings.

• Construct and maintain GenAI pipelines, encompassing fine-tuning, RAG, multi-modal inference, and LLMOps.

• Create reusable infrastructure templates through Terraform and Helm.

• Drive internal innovation via Proofs of Concept (PoCs) and workshops.

• Assist in client-facing delivery initiatives.

⛳️ Requirements

• Over 10 years of relevant experience.

• Extensive experience with Slurm and distributed training environments.

• Practical expertise in Red Hat OpenShift and/or Kubernetes.

• In-depth understanding of the NVIDIA GPU ecosystem, including CUDA, cuDNN, NCCL, Nsight, and Triton/TensorRT.

• Solid foundation in Linux systems, performance tuning, and multi-GPU optimization.

• Proven experience in deploying GenAI workloads, including LLM fine-tuning, RAG pipelines, and multi-modal systems.

• Familiarity with Infrastructure-as-Code tools like Terraform and Ansible.

• Experience with cloud GPU environments such as GCP, Azure, AWS, OCI, and/or on-premises GPU clusters.

• Knowledge of NVIDIA NIMs, DGX systems, or GPU-accelerated containers.

• Understanding of LLMOps frameworks and their integration within MLOps.

• Familiarity with vector databases and retrieval systems tailored for RAG architectures.

• Comfortable in client-facing roles and collaborating with AI solution teams.

• Experience in the healthcare domain is a plus: FHIR R4, HL7 v2, SMART on FHIR, EHR systems such as Epic, HIPAA compliance, clinical workflows, CDS Hooks, patient-facing applications, clinical decision support systems, or healthcare interoperability solutions.

🏝️ Benefits

• Enhance your skills and uncover your potential through challenging projects involving cutting-edge technology.

• Be part of a research-driven organization with over 60 patents filed.

• Gain exposure to AI, ML, data, and cloud technologies.

• Work with Fortune 500 companies and gain valuable insights.

• Opportunities for learning, growth, and collaboration with colleagues from diverse experiences and backgrounds globally.

• Enjoy a diverse and hybrid work culture.