Staff Backend AI Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop The Agentic Platform: Architect, create, and manage the backend systems that drive Arbiter’s agent-oriented care orchestration workflows, which encompass service orchestration, inference pipelines, and automation primitives.

• Production AI Systems: Deliver and sustain production-level AI systems that streamline intricate clinical and administrative workflows, with actual customer reliance and stringent requirements for reliability, latency, and accuracy.

• Platform Architecture & Scalability: Play a role in defining the architectural structure of Arbiter’s AI-powered platform, focusing on modularity, extensibility, scalability, and seamless integration with EMRs, data systems, and external services.

• Inference & Backend Reliability: Guarantee optimal performance, minimal latency, and fault tolerance across backend services and AI inference pipelines through effective system design, monitoring, and operational best practices.

• Infrastructure & Deployment Excellence: Establish and maintain best practices for CI/CD, testing, observability, and the deployment of backend and AI systems in live environments.

• Cross-Functional Execution: Collaborate closely with data scientists, product managers, clinical specialists, and other engineers to convert unclear, high-impact challenges into scalable technical solutions.

• Technical Leadership & Mentorship: Guide engineers, contribute to internal documentation and standards, influence technical strategies, and elevate the overall engineering quality.

• Ownership & On-Call: Assume complete responsibility for critical systems, including partaking in on-call rotations and spearheading incident resolution during production issues.

⛳️ Requirements

• Over 8 years of practical experience in building and managing production backend systems, with recent involvement in AI-driven services and automation workflows in high-availability settings.

• Degree in Computer Science or Engineering, or equivalent hands-on experience.

• Proven experience in developing and maintaining extensive Python codebases, with strong views on structure, quality, and trade-offs.

• Demonstrated expertise in designing and operating complex backend systems in a production environment.

• In-depth knowledge of concurrency, scalability, reliability, and distributed systems patterns.

• Practical experience with asynchronous or event-driven architectures.

• Familiarity with designing and managing high-scale APIs (REST and/or gRPC), including versioning and backward compatibility considerations.

• Experience with cloud infrastructures (AWS, GCP, or Azure) and production deployments.

• Background in building and deploying AI-powered systems beyond mere prototypes or internal demonstrations.

• Excellent communication skills and the ability to collaborate effectively across various functions.

🏝️ Benefits

• Highly Competitive Salary & Equity Package: Tailored to compete with top FAANG compensation, including significant equity.

• Generous Paid Time Off (PTO): To promote a healthy work-life balance.

• Comprehensive Health, Vision, and Dental Insurance: Extensive coverage for you and your family.

• Life and Disability Insurance: Ensuring financial security.

• Simple IRA Matching: To assist in achieving your long-term financial objectives.

• Professional Development Budget: Funding for conferences, courses, and certifications to enhance your continuous learning.

• Wellness Programs: Initiatives designed to support your physical and mental well-being.