Senior Software Engineer, AI Infrastructure

This is a fully remote position, open to applicants in Kazakhstan, +1 more country.

📋 Description

• Design and develop the infrastructure for LLM serving on Kubernetes, encompassing deployment, GPU scheduling, scaling, and management of model lifecycles.

• Prepare the platform for enterprise settings through Helm-based installations, upgrades, and support for restricted or offline networks.

• Connect the serving layer with the platform's API gateway, identity services, and metering functions.

• Create observability for GPU inference operations in production, including serving metrics and GPU telemetry.

• Contribute to a multi-service codebase.

• Assist in establishing engineering direction via design documents and reviews.

• Become part of a small senior team with extensive responsibility for the model-serving layer and its journey to production.

⛳️ Requirements

• Over 5 years of experience in software engineering focused on infrastructure, platforms, or distributed systems.

• Extensive hands-on experience with Kubernetes, including building and managing production workloads and Helm charts.

• Familiarity with GPU workloads or LLM inference, or significant experience with related systems and a proven ability to learn quickly.

• Proficient in Go programming.

• Strong skills in CI/CD and infrastructure-as-code practices.

• Comfortable using AI-assisted development tools such as Claude Code and OpenAI Codex.

• Ability to work autonomously within a small, remote-first team that emphasizes written communication.

• Nice to have: Experience in inference performance optimization, including quantization, batching, or caching.

• Nice to have: Knowledge of distributed serving frameworks.

• Nice to have: Experience with enterprise deployments, including air-gapped installations, SSO/OIDC, and supply-chain security.

• Nice to have: UI development experience with technologies such as React/TypeScript.

• Nice to have: Contributions to open-source projects within the Kubernetes or ML-infrastructure communities.

🏝️ Benefits

• Opportunities for professional development and training.

• Participation in conferences and working groups.

• Company outings, happy hours, hackathons, and tech talks.

• Competitive compensation package accompanied by a robust benefits plan.

• Collaborate with passionate, skilled colleagues and Fortune 500 and Global 2000 clients.

• Engage in cutting-edge, open-source innovation.

• Thrive in a high-energy environment that values openness, collaboration, risk-taking, and ongoing growth.