Senior Solutions Architect – Large Scale AI Training

This is a fully remote position, open to applicants in Poland, +4 more countries.

📋 Description

• Establish and nurture strategic technical partnerships with top EMEA AI model developers who are creating large-scale foundation models.

• Specify software stacks and infrastructure for extensive training and post-training workflows, including Reinforcement Learning.

• Advise customers on distributed training methodologies and effective large-scale training and post-training techniques using PyTorch, Megatron-LM, or NeMo (RL/Gym).

• Assist customers in enhancing training and fine-tuning efficiency on a large scale, focusing on GPU utilization, communication overlap, and memory management.

• Work in collaboration with NVIDIA's product and research teams to relay customer requirements.

• Develop the NVIDIA product roadmap informed by customer insights.

• Organize or support hackathons, demonstrations, and technical conferences to engage the developer community.

⛳️ Requirements

• MS or PhD in Computer Science, Engineering, or equivalent experience.

• More than 7 years of hands-on experience in distributed AI training.

• Direct experience with HPC and/or AI settings featuring multi-node GPU clusters.

• Strong comprehension of training infrastructure and its impact on efficiency and scalability.

• Proficient in Megatron-LM, NeMo, or similar distributed training frameworks.

• Exceptional communication skills with the ability to engage research scientists and infrastructure engineers effectively.

• Experience in large-scale fine-tuning using Reinforcement Learning (RLVR, RLHF).

• Familiarity with LatentMoE, expert load balancing, and speculative decoding for MoE inference.

• Previous experience in an AI Datacenter/HPC center, national lab, or cutting-edge AI lab environment.

• Published works or contributions to open-source projects in the field of distributed training.

🏝️ Benefits

• Highly competitive salaries.

• Comprehensive benefits package.

• Equal opportunity employer.