Senior Server Engineer, Foundations

Posted 17 hours ago

This is a fully remote position, open to applicants in United States.

📋 Description

• Collaborate, construct, and oversee essential components of the shared foundation utilized by every Raya engineering team.

• Develop and sustain AI infrastructure, which includes an LLM gateway, model routing, spend tracking, and code review agents.

• Update server architecture, draft technical specifications, make trade-offs, plan safe delivery, and promote adoption across engineering teams.

• Create and implement AI-collaborative development tools, including model routing, evaluation harnesses, and cloud agents.

• Establish engineering standards through design reviews, code reviews, and thorough documentation.

• Manage the complete Software Development Life Cycle for delivered systems, covering CI/CD, observability, alarm coverage, security remediation, and on-call duties.

• Act as an escalation point for in-depth production debugging.

• Mentor engineers through pairing, code reviews, and direct feedback.

• Own a roadmap consisting of approximately 80% roadmap work and 20% operational maintenance.


⛳️ Requirements

• Over 5 years of hands-on experience in building and operating production server software, with a proven history of delivering scalable and maintainable systems and evolving into a technical leader within your organization.

• Demonstrated proficiency in system design, architecture, and expertise in Node.js and TypeScript.

• Proven experience in constructing and scaling backend systems in production at a startup or fast-paced environment.

• Hands-on experience with MongoDB and/or PostgreSQL in production, including performance tuning.

• Experience owning platform, infrastructure, or developer-productivity initiatives that other teams rely on (shared libraries, CI/CD, development tooling, observability, or security remediation) and driving its adoption.

• Experience in building and deploying products with LLMs or AI agents in production, beyond just a chat interface.

• Passion for new AI tools and frameworks, along with a readiness to swiftly adopt emerging best practices.

• Familiarity with LiteLLM, Amazon Bedrock, or similar model-routing layers.

• Experience with prompt engineering, evaluations, or fine-tuning in production settings.

• Proficient with AWS, Docker/Kubernetes, and CI/CD.

• Comfortable handling the security and infrastructure aspects of running a consumer product at scale.

• Successfully led a large architecture migration across a codebase that other teams rely on, ensuring its adoption.

• A bias towards shipping and iteration: capable of building rapidly, learning, and refining in short cycles.


🏝️ Benefits

• Comprehensive medical and dental coverage.

• $50 daily food delivery budget.

• Equity-based employment.

• A positive and engaging culture.

• Opportunities for learning and growth.

• Unlimited vacation policy.

• 12 weeks of paid parental leave.

• $1,000 annually for travel to a new destination.

People also viewed

CI&T16 hours ago

Senior Backend Developer, Python/AI

BR flagBrazil OnlyFull-timeBackend Engineer
ApplyView job
dentsu Austria16 hours ago

Senior Braze Platform Architect

GE flagGeorgia OnlyFull-timeBackend Engineer$94k – $150k/year
ApplyView job
Owens & Minor16 hours ago

SAP Technical Architect

US flagUnited States OnlyFull-timeBackend Engineer$160k/year
ApplyView job
Affirm17 hours ago

Senior Software Engineer, Backend

CA flagCanada OnlyFull-timeBackend EngineerC$153k – C$213k/year
ApplyView job
TELUS Digital17 hours ago

Senior Consultant – Technical Architect

US flagUnited States OnlyFull-timeBackend Engineer$100k – $190k/year
ApplyView job
EDB17 hours ago

Platform Engineer – Kubernetes Operators

US flagUnited States OnlyFull-timeBackend Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers