
Backend Engineer
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Canada.
• Design and manage distributed computing services, control planes, gateways, and telemetry agents across a network of inference GPU servers.
• Develop and maintain the DNS and networking framework that directs customer requests across various sites.
• Automate the deployment of customer model images on PolarGrid's GPU infrastructure.
• Create infrastructure as code, manage versioned releases via CI, and establish monitoring and alerting systems.
• Implement security best practices regarding authentication, data handling, secrets management, and tenant isolation.
• Oversee technical decision-making, implementation processes, and ensure operational reliability.
• Construct, operate, and provide support for systems in a production environment.
• Experience with production backend services in Python, Go, or Rust, including on-call responsibilities.
• Proficiency in setting up and executing open-source models on inference backends such as vLLM, SGLang, TensorRT-LLM, llama.cpp, or Triton Inference Server.
• Background in operating bare-metal Linux servers and managing containerized workloads.
• Expertise in writing infrastructure as code and developing CI pipelines.
• Knowledge in implementing DNS or load balancing solutions.
• Familiarity with security best practices and a commitment to test-driven development.
• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance plans.
• Flexible working hours and remote work options.
• Opportunities for professional development and continuing education.
• A collaborative and inclusive work environment.
CI&T
dentsu Austria
Owens & Minor
Affirm
Get handpicked remote jobs straight to your inbox weekly.