Software Engineer – AI, HPC Middleware

This is a fully remote position, open to applicants in New York.

📋 Description

• Design and enhance Cornelis Networks' AI/HPC communication middleware.

• Develop and refine HPC middleware (MPI/SHMEM) and AI middleware collective communication libraries (CCL), which includes NCCL/RCCL and associated stacks.

• Integrate middleware functionalities with transport and provider layers such as libfabric/OFI, UCX, and relevant verbs-like semantics.

• Prepare and submit contributions to upstream projects related to MPI/SHMEM, CCL ecosystems, and other associated components.

• Work collaboratively with kernel/driver and switch teams to achieve end-to-end performance that aligns with the product roadmap.

• Analyze performance traces and replicate customer-related issues.

• Convert performance insights into actionable fixes.

• Participate in feature development, testing, and upstream open-source contributions across driver/kernel, switches, systems, and application/framework teams.

⛳️ Requirements

• A minimum of 2 years of experience in systems programming using C/C++ on Linux.

• Bachelor's degree in Computer Science, Engineering, or a related discipline, or equivalent experience.

• Familiarity with or coursework/project experience in HPC middleware such as MPI/SHMEM.

• Familiarity with or coursework/project experience in AI collective communication libraries like NCCL/RCCL, CUDA/ROCm, or other CCL stacks.

• Understanding of performance concepts with the ability to diagnose issues using profiling/tracing tools, or a strong eagerness to learn.

• Basic understanding of networking and/or RDMA concepts.

• Prior experience contributing to open-source projects is preferred.

• Exposure to libfabric providers is preferred.

• Familiarity with Ultra Ethernet (UEC/UET) specifications is preferred.

• Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA implementations is preferred.

• Competence in benchmarking, profiling, and optimization is preferred.

• Background in Omni-Path/OPX or Ethernet-based HPC fabrics is preferred.

🏝️ Benefits

• Equity, cash, and incentives.

• Health, medical, dental, and vision coverage.

• Disability and life insurance.

• Dependent care flexible spending account.

• Accidental injury insurance.

• Pet insurance.

• Generous paid holidays.

• 401(k) with company match.

• Open Time Off (OTO) for regular full-time exempt employees.

• Sick time.

• Bonding leave.

• Pregnancy disability leave.

• Flexible work environment.