Senior Software Engineer, Agentic AI

📋 Description

• Design, create, and implement clinical AI agents that assess patient context, utilize tools, and provide care recommendations.

• Take responsibility for the reliability, observability, and cost efficiency of LLM-powered workflows on a large scale.

• Construct and enhance RAG pipelines that integrate clinical knowledge bases, treatment protocols, and real-time patient information.

• Create evaluation frameworks including offline benchmarks, safety assessments, regression suites, and LLM-as-judge pipelines integrated into CI/CD.

• Develop multi-step agent orchestration involving planning, memory management, tool utilization, error recovery, and human-in-the-loop escalation pathways.

• Collaborate with clinical, product, and engineering teams to convert patient care requirements into AI system designs.

• Remain updated on AI and engineering best practices, consistently encouraging the team to elevate standards in quality, performance, and architecture.

⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related discipline, or equivalent professional experience.

• Over 5 years of software engineering experience, including at least 2 years developing AI/ML-powered systems in a production environment.

• Practical experience with LLM APIs (OpenAI, Anthropic, open-source models), including prompt engineering, tool usage/function calling, and structured outputs.

• Background in building RAG systems, including embeddings, vector storage, retrieval optimization, and grounding techniques.

• Experience in a high-growth, fast-paced setting with complete ownership from design to production.

• NICE TO HAVE: Familiarity with agent frameworks or orchestration patterns (such as tool calling, planners, multi-agent coordination).

• Experience in fine-tuning (SFT, RLHF, LoRA) for domain-specific tasks.

• Prior experience in healthcare or regulated industries (such as HIPAA, SOC 2, and clinical data management).

🏝️ Benefits

• Medical, dental, and vision insurance.

• Competitive total compensation and substantial equity.

• TelaDoc (virtual primary care services).

• National and local discounts provided by TriNet.

• Unlimited paid time off and paid holidays.

• Remote equipment setup and home office allowance.

• Paid Parental Leave.

• 401K plan with matching contributions.

• Charitable Donation Matching program.