Senior Deep Learning Software Engineer, Inference

This is a fully remote position, open to applicants in New York, +3 more states.

📋 Description

• Optimize performance, analyze, and fine-tune deep learning models across various domains, including LLM, Multimodal, and Generative AI.

• Enhance the performance of deep learning models on multiple architectures and various types of NVIDIA accelerators.

• Contribute to the development of features and code for NVIDIA’s inference libraries, including vLLM, SGLang, FlashInfer, and LLM software solutions.

• Collaborate with cross-functional teams across frameworks, NVIDIA libraries, and innovative solutions for inference optimization.

⛳️ Requirements

• A Master's degree, PhD, or equivalent experience in a relevant field such as Computer Engineering, Computer Science, EECS, or AI.

• Over 5 years of relevant experience in software development.

• Strong programming and software design skills in C/C++.

• Proficiency in Agile software development methodologies is advantageous.

• Experience with Python is considered a plus.

• Prior experience in training, deploying, or optimizing the inference of deep learning models in production is beneficial.

• A background in performance modeling, profiling, debugging, and code optimization, as well as architectural knowledge of CPU and GPU, is a plus.

• Experience in GPU programming (CUDA, OAI TRITON, or CUTLASS) is advantageous.

🏝️ Benefits

• Health insurance

• Retirement plans

• Paid time off

• Flexible work arrangements

• Professional development

• Bonuses

• Stock options

• Equity