Senior Software Engineer

Posted Nov 11

This is a fully remote position, open to applicants in North Carolina.

📋 Description

• Design and develop infrastructure for LLM serving on Kubernetes, encompassing deployment, GPU scheduling, scaling, and management of the model lifecycle.

• Package the platform for enterprise use with Helm-based installations and upgrades, accommodating restricted or offline networks.

• Integrate the serving layer with the platform’s API gateway, identity management, and metering services.

• Create observability features for operating GPU inference in production, including serving metrics and GPU telemetry.

• Contribute to a multi-service codebase.

• Assist in defining engineering direction through design documents and code reviews.


⛳️ Requirements

• Over 5 years of experience in software engineering, focusing on infrastructure, platforms, or distributed systems.

• Extensive hands-on experience with Kubernetes for building and managing production workloads and Helm charts.

• Familiarity with GPU workloads or LLM inference, or a strong background in adjacent systems with a proven ability to learn quickly.

• Proficient in Go programming.

• Strong skills in CI/CD and infrastructure-as-code methodologies.

• Comfortable using AI-assisted development tools, such as Claude Code and OpenAI Codex, as part of the daily engineering process.

• Ability to work autonomously in a small, remote-first team with a strong written culture.

• Experience in inference performance, enterprise deployment, UI development, and open-source contributions is a plus.


🏝️ Benefits

• Competitive compensation package.

• Comprehensive benefits plan.

• Opportunities for open-source innovation.

• Collaboration with skilled colleagues.

• Environment conducive to continuous growth.

People also viewed

Zen Educate2 days ago

Product Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer$130k – $190k/year
ApplyView job
Weekday (YC W21)2 days ago

Full Stack Builder – B2B SaaS

IN flagIndia OnlyFull-timeFull-stack Engineer₹5.5M – ₹6M/year
ApplyView job
Toast2 days ago

Staff Software Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer$151k – $309k/year
ApplyView job
Milliman2 days ago

Software Engineer, R&D – IntelliScript

US flagAlaska, +10 more statesFull-timeFull-stack Engineer$80.4k – $203k/year
ApplyView job
Greenhouse Software2 days ago

Senior Software Engineer

CA flagCanada OnlyFull-timeFull-stack EngineerC$129k – C$164.5k/year
ApplyView job
AppFolio2 days ago

Staff Software Engineer – Owner, Investor

US flagCalifornia, +6 more locationsFull-timeFull-stack Engineer$167.2k – $229.9k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers