Senior Deep Learning Compiler Engineer – XLA

This is a fully remote position, open to applicants in California, +2 more states.

📋 Description

• Develop optimization algorithms for compilers specifically tailored for deep learning workloads.

• Enhance both inference and training performance for the JAX framework and the OpenXLA compiler on NVIDIA GPUs at scale.

• Collaborate effectively with teams in deep learning frameworks as well as hardware architecture.

• Design and implement optimization techniques for compiler-based deep learning network graphs.

• Create techniques for graph partitioning and tensor sharding to support distributed training and inference.

• Conduct performance tuning and analysis to ensure optimal operation.

• Implement code generation for NVIDIA GPU backends utilizing open-source compilers like MLIR, LLVM, and OpenAI Triton.

• Design features aimed at users within JAX and its related libraries.

• Engage in general software engineering tasks.

• Collaborate closely with GPU hardware engineering teams to develop AI compiler software features for next-generation GPUs.

⛳️ Requirements

• Bachelor’s, Master’s, or Ph.D. in Computer Science, Computer Engineering, or a related field (or equivalent experience).

• Over 4 years of relevant experience in performance analysis and compiler optimizations, either in work or research.

• Capacity to work independently, set project goals and scope, and lead your own development initiatives while adhering to clean software engineering and testing methodologies.

• Exceptional skills in C/C++ programming and software design, including debugging, performance analysis, and test design.

• Strong understanding of the architecture of CPUs, GPUs, or other high-performance hardware accelerators.

• Familiarity with high-performance computing and distributed programming.

• Experience with CUDA or OpenCL programming is preferred but not essential.

• Background in XLA, TVM, MLIR, LLVM, OpenAI Triton, deep learning models and algorithms, and deep learning framework design is a significant advantage.

• Strong interpersonal abilities.

• Capability to thrive in a dynamic, product-oriented team environment.

• Previous experience mentoring junior engineers and interns is a plus.

• Experience with deep learning frameworks like JAX, PyTorch, or TensorFlow will help you stand out.

• Extensive experience with CUDA or GPUs in general will set you apart.

• Familiarity with open-source compilers such as XLA, LLVM, MLIR, or TVM will distinguish you from other candidates.

🏝️ Benefits

• Equity.

• Comprehensive benefits package.

• Competitive salary.