Senior Software Engineer – AI/HPC Middleware

This is a fully remote position, open to applicants in New York.

📋 Description

• Develop and enhance features for HPC middleware (HPI and SHMEM) and AI middleware, including CCL stacks such as NCCL/RCCL.

• Merge middleware functionalities with transport and provider layers like libfabric/OFI, UCX, and verbs-like semantics.

• Prepare and submit contributions to upstream projects across MPI/SHMEM, CCL ecosystems, and other open-source components.

• Collaborate with kernel/driver and switch teams to achieve end-to-end performance in line with the product roadmap.

• Analyze performance traces and replicate customer issues.

• Convert customer insights into actionable fixes.

• Participate in the design, development, and upstream enablement of AI/HPC communication middleware utilizing Cornelis Networks interconnects.

• Champion performance, correctness, and deployability across actual customer workloads.

⛳️ Requirements

• Over 6 years of experience in systems programming using C/C++ on Linux.

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent professional experience.

• Practical experience with HPC middleware internals such as Open MPI, MPICH, MVAPICH, and/or SHMEM.

• Proven track record in optimizing AI collective communications, including NCCL/RCCL, CUDA/ROCm, and/or other CCL stacks.

• Capability to deliver low-latency and high-throughput communication pathways.

• Proficient in diagnosing performance issues using profiling and tracing tools.

• Working knowledge of OFI/libfabric, UCX, and verbs-style concepts.

• Strong foundation in RDMA concepts and performance tuning.

• Experience contributing to open-source projects.

• Familiarity with Ultra Ethernet (UEC/UET) specifications is preferred.

• Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments is preferred.

• Background in cluster-scale benchmarking, profiling, and optimization is preferred.

• Experience with HPC fabrics such as Omni-Path is preferred.

🏝️ Benefits

• Equity, cash, and incentives.

• Health insurance.

• Retirement benefits.

• Medical, dental, and vision coverage.

• Disability and life insurance.

• Dependent care flexible spending account.

• Accidental injury insurance.

• Pet insurance.

• Generous paid holidays.

• 401(k) with company match.

• Open Time Off (OTO) for regular full-time exempt employees.

• Sick time.

• Bonding leave.

• Pregnancy disability leave.

• Flexible work environment.