
Senior Server Engineer, Foundations
Posted 17 hours ago

Posted 17 hours ago
This is a fully remote position, open to applicants in United States.
• Collaborate, construct, and oversee essential components of the shared foundation utilized by every Raya engineering team.
• Develop and sustain AI infrastructure, which includes an LLM gateway, model routing, spend tracking, and code review agents.
• Update server architecture, draft technical specifications, make trade-offs, plan safe delivery, and promote adoption across engineering teams.
• Create and implement AI-collaborative development tools, including model routing, evaluation harnesses, and cloud agents.
• Establish engineering standards through design reviews, code reviews, and thorough documentation.
• Manage the complete Software Development Life Cycle for delivered systems, covering CI/CD, observability, alarm coverage, security remediation, and on-call duties.
• Act as an escalation point for in-depth production debugging.
• Mentor engineers through pairing, code reviews, and direct feedback.
• Own a roadmap consisting of approximately 80% roadmap work and 20% operational maintenance.
• Over 5 years of hands-on experience in building and operating production server software, with a proven history of delivering scalable and maintainable systems and evolving into a technical leader within your organization.
• Demonstrated proficiency in system design, architecture, and expertise in Node.js and TypeScript.
• Proven experience in constructing and scaling backend systems in production at a startup or fast-paced environment.
• Hands-on experience with MongoDB and/or PostgreSQL in production, including performance tuning.
• Experience owning platform, infrastructure, or developer-productivity initiatives that other teams rely on (shared libraries, CI/CD, development tooling, observability, or security remediation) and driving its adoption.
• Experience in building and deploying products with LLMs or AI agents in production, beyond just a chat interface.
• Passion for new AI tools and frameworks, along with a readiness to swiftly adopt emerging best practices.
• Familiarity with LiteLLM, Amazon Bedrock, or similar model-routing layers.
• Experience with prompt engineering, evaluations, or fine-tuning in production settings.
• Proficient with AWS, Docker/Kubernetes, and CI/CD.
• Comfortable handling the security and infrastructure aspects of running a consumer product at scale.
• Successfully led a large architecture migration across a codebase that other teams rely on, ensuring its adoption.
• A bias towards shipping and iteration: capable of building rapidly, learning, and refining in short cycles.
• Comprehensive medical and dental coverage.
• $50 daily food delivery budget.
• Equity-based employment.
• A positive and engaging culture.
• Opportunities for learning and growth.
• Unlimited vacation policy.
• 12 weeks of paid parental leave.
• $1,000 annually for travel to a new destination.
CI&T
dentsu Austria
Owens & Minor
Affirm
Get handpicked remote jobs straight to your inbox weekly.