Senior Software Engineer, Distributed Systems

This is a fully remote position, open to applicants in California, +2 more states.

📋 Description

• Design and develop factory infrastructure and automation for NVIDIA Inference Microservices (NIMs)

• Create efficient, scalable, and dependable automation factory infrastructure

• Establish infrastructure and workflows aimed at optimizing and delivering AI inference across diverse cluster environments

• Create a factory pipeline that converts AI models into deployable services verified across cloud, on-premises, and Kubernetes environments

• Define and execute technical strategies and roadmaps for the NIM factory

• Design interfaces, data models, schemas, and observability for the factory pipeline and computational infrastructure

• Develop scalable and reliable components for the factory

• Collaborate with AI model teams to comprehend requirements and enhance productivity

• Establish metrics and drive enhancements based on user feedback

• Mentor and work alongside team members and other teams

• Construct infrastructure, pipelines, backends, Docker builds, test harnesses, metrics, performance engineering, and log ingestion for NIM factory capabilities

⛳️ Requirements

• Advanced programming expertise in distributed and compute systems, backend services, microservices, and cloud technologies

• Experience collaborating with multifunctional teams, principals, and architects across organizational boundaries

• Experience in mentorship and the capacity to develop teams and individual team members

• Adaptability to modify direction and expectations based on customer needs

• Profound technical knowledge in distributed containerized applications

• Proficient in Docker, Kubernetes (K8s), Cloud Endpoints, Helm, and Prometheus

• Experience in building and testing microservice applications and automation pipelines

• Exceptional interpersonal skills with the ability to lead multifunctional initiatives

• Experience in debugging and analyzing the performance of distributed microservices or cloud systems

• BS or MS in Computer Science, Computer Engineering, or a related field, or equivalent experience

• Over 8 years of experience in developing high-performance microservice, cloud software, and/or tooling

• Experience in delivering event-driven applications utilizing Temporal, Kafka, Redis, or similar services

• Experience in building and deploying containers for microservices, cloud, and on-premises deployments, including related CI/CD pipelines

• Previous experience with large-scale full-stack development

🏝️ Benefits

• Equity

• Benefits