Senior Software Engineer, AI Infrastructure

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop LLM serving infrastructure utilizing Kubernetes.

• Execute deployment, GPU scheduling, scaling, and model lifecycle management.

• Create a platform suitable for enterprise settings using Helm-based installations and upgrades.

• Facilitate deployments in restricted and offline environments.

• Integrate the serving layer with API gateway, identity management, and metering services.

• Establish observability for production GPU inference, including serving metrics and GPU telemetry.

• Contribute to a multi-service codebase.

• Assist in shaping engineering direction through design documents and code reviews.

⛳️ Requirements

• A minimum of 5 years of software engineering experience in infrastructure, platform, or distributed systems.

• Extensive hands-on experience with Kubernetes, including building and managing production workloads and Helm charts.

• Familiarity with GPU workloads or LLM inference, or a strong background in adjacent systems with a proven ability to learn quickly.

• Proficient in Go programming.

• Strong skills in CI/CD and infrastructure-as-code.

• Experience with AI-assisted development tools, such as Claude Code and OpenAI Codex, integrated into daily engineering tasks.

• Comfortable working autonomously within a small, remote-first team that values written communication.

• Nice to have: experience in inference performance work, including quantization, batching, or caching.

• Nice to have: familiarity with distributed serving frameworks.

• Nice to have: experience in enterprise deployment, including air-gapped installations, SSO/OIDC, and supply-chain security.

• Nice to have: background in UI development, such as React/TypeScript.

• Nice to have: contributions to open-source projects in the Kubernetes or ML-infrastructure ecosystems.

🏝️ Benefits

• Opportunities for professional development and training.

• Attendance at conferences and working groups.

• Company events, happy hours, hackathons, and tech talks.

• Competitive compensation package complemented by a robust benefits plan.

• Chance to collaborate with passionate colleagues and Fortune 500 as well as Global 2000 clients.

• Environment that fosters open-source innovation.

• Continuous opportunities for growth.