Senior Backend Engineer, AI Platform

This is a fully remote position, open to applicants in Florida.

📋 Description

• Develop AI-driven functionalities for a social media platform catering to millions of users.

• Collaborate closely with the platform architect and fellow developers.

• Establish fundamental AI infrastructure in a newly created environment.

• Influence engineering practices as the team expands.

• Integrate services utilizing Ruby on Rails and React/TypeScript.

• Manage backend services comprehensively, from schema design to deployment and on-call responsibilities.

• Create and maintain LLM serving, retrieval, evaluation, instrumentation, and safety features.

⛳️ Requirements

• Over 5 years of backend engineering experience in a statically typed programming language (Go, Java, Kotlin, C#).

• Proven experience in deploying LLM-based features, including retrieval-augmented generation, streaming responses, and tool utilization.

• Practical knowledge of LLM serving infrastructure, involving routing across various model providers, failover strategies, token streaming, and cost/usage monitoring.

• Experience in developing retrieval systems, including vector search, embedding pipelines, context assembly, and citation-backed responses.

• Capability to design instrumentation for hallucinations, retrieval misses, provider outages, and cost overruns.

• Familiarity with evaluating AI answer quality based on relevance, safety, source quality, and repeatable assessments.

• Strong skills in API design.

• Ability to take ownership of a service from schema design through deployment and on-call duties.

• Must be based in the US and authorized to work in the United States.

• Proficiency in Go is strongly preferred.

• Experience with Python.

• Knowledge of LLM gateways or serving infrastructure such as LiteLLM, vLLM, or TGI.

• Familiarity with vector databases like Qdrant or pgvector and their embedding pipelines.

• Experience in fine-tuning open-weight models using LoRA or through complete fine-tunes.

• Background in content moderation or safety tooling.

• Understanding of Ruby on Rails or React/TypeScript.

🏝️ Benefits

• Opportunity to work on cutting-edge AI technology.

• Collaborative and innovative team environment.

• Competitive salary and benefits package.

• Opportunities for professional growth and development.