Principal Software Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of the architecture for AI voice agent platforms, next-best-action AI assistant guidance, or independent AI agents across voice, chat, and SMS.

• Develop real-time, low-latency systems for in-call intent detection and next-best-action recommendations.

• Create orchestration layers that expose AI agent workflows as reusable, callable actions with defined output contracts and versioning.

• Establish protocols for patient/customer identification, context retrieval, escalation contracts, safe failure processes, human handoff, and audit trails.

• Propel the evaluation and reliability frameworks for AI agents and set service level objectives (SLOs) for agent-facing services.

• Lead both high-level and low-level technical design reviews for backend services.

• Ensure architectural consistency across ticketing, case management, scheduling, transcription, and speech-processing services.

• Design and develop asynchronous Python backend services utilizing FastAPI and Django.

• Model data using MongoDB and PostgreSQL.

• Construct Kafka-based event streams for cross-service and agent-to-core communication.

• Engage hands-on with LLM/AI agent tools such as LangChain, pydantic-ai, and MLflow.

• Establish standards for testing, observability, and production triage.

• Mentor senior and mid-level engineers in distributed systems and AI-agent architecture.

• Collaborate with the product team to define and sequence ambiguous initiatives into phased technical plans.

• Implement healthcare security and compliance practices in handling PHI, audit logging, authentication, and agent context retrieval.

⛳️ Requirements

• Over 8 years of experience in backend engineering.

• Proven technical ownership of a complex, multi-service system.

• Strong expertise in Python, including asynchronous programming (asyncio).

• Production experience with FastAPI or Django frameworks.

• Background in designing distributed, multi-service architectures.

• Familiarity with event-driven systems such as Kafka.

• Experience with service-to-service authentication, webhook integrations, and idempotency/retry design.

• Proficiency with MongoDB or another NoSQL database.

• Working knowledge of relational databases, particularly PostgreSQL.

• Direct production experience in building or managing conversational AI/voice agent systems, including telephony, IVR, or conversational voice platforms.

• Background in latency-sensitive real-time pipelines involving speech-to-text, speaker separation, and text-to-speech processes.

• Experience in designing real-time decisions from streaming context with confidence thresholds and human-in-the-loop escalation.

• Familiarity with LLM/agent frameworks.

• Understanding of agent evaluation and reliability practices.

• Proven ability to drive architectural decisions across teams and to write and review technical design documents.

• Experience guiding and mentoring other engineers.

• Comfortable working with Docker/containerized deployments, CI/CD, and observability tools.

• Proficient with Git and collaborative workflows.

• Knowledge of healthcare data security and compliance practices, including PHI handling, audit logging, OAuth/JWT authentication, and minimum-necessary data scoping.

🏝️ Benefits

• 20 days of fixed time off each year, in addition to company holidays.

• Generous parental leave policy.

• Monetary incentives and recognition at the company-wide level.

• Comprehensive medical, dental, and vision insurance.

• 100% employer-paid short- and long-term disability insurance.

• 100% employer-paid basic life insurance.

• Optional discounted legal aid services.

• Optional pet insurance coverage.