Senior Software Engineer, NeMo Core Platform

This is a fully remote position, open to applicants in Canada.

📋 Description

• Design an Agentic Execution system that is adaptable to local, Kubernetes, Slurm, on-premises, and air-gapped environments.

• Provide senior technical leadership through design reviews, code reviews, mentoring, and managing complex cross-component challenges.

• Develop and maintain Core Platform APIs for executing jobs, managing data, entities, secrets, RBAC, and authentication.

• Enhance the versatile plugin architecture for internal teams as well as external customers.

• Contribute to open-source projects in NVIDIA's repository.

• Deliver production-ready code utilizing agentic coding tools.

• Enhance reliability, observability, debuggability, and performance across the NeMo Platform, SDKs, plugins, jobs, and developer workflows.

• Establish robust test coverage across unit, integration, end-to-end, Docker, and Kubernetes workflows.

• Operate within a product research setting that emphasizes rapid iteration, strong ownership, practical decision-making, and performance-focused implementation.

⛳️ Requirements

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical discipline.

• Over 10 years of professional software engineering experience in developing production systems.

• Ability to thrive in a fast-paced and ambiguous environment.

• Excellent verbal and written communication skills.

• Proficiency in producing and reviewing high-quality architectural RFCs.

• Strong skills in system design.

• Solid understanding of reliability, scalability, security, and performance trade-offs in production infrastructure.

• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration.

• Exceptional Python engineering skills, encompassing API design, typing, testing, debugging, performance analysis, and maintainable software design.

• Experience in designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces.

• Capability to work independently, define technical scope, decompose ambiguous problems, and collaborate across team boundaries.

• Preferred: experience in building, deploying, and iterating on production agentic AI systems at scale in Kubernetes.

• Preferred: familiarity with sophisticated plugin architectures.

• Preferred: ability to relate technical evaluation efforts to business outcomes, product quality, user experience, reliability, or operational efficiency.

• Preferred: experience with enterprise AI systems that necessitate measurement, regression testing, observability, governance, and continuous improvement.

🏝️ Benefits

• Equity

• Benefits