Senior Software Engineer, AI Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and manage Kinetic's agent orchestration layer, which includes model routing, tools, memory, permissions, and guardrails.

• Deploy prompts, tools, and model versions via CI/CD while tracking costs and latency, along with rollback capabilities.

• Create MCP servers and tools that ensure secure agent access to Salesforce, Athena, and claims data.

• Enforce PHI and PII redaction alongside comprehensive audit logs.

• Construct evaluation harnesses and rollout gates utilizing golden datasets prior to production deployment.

• Establish human-in-the-loop checkpoints for critical decision-making processes.

• Replatform or phase out standalone AI scripts and workflows.

• Set standards and evaluate agent designs and code.

• Mentor engineers involved in agent development across Kinetic.

• Assess the appropriateness of using AI versus purchasing or building systems and components.

• Write production code on a daily basis and provide technical leadership for agent infrastructure.

• Collaborate with product and platform development teams.

• Report directly to the Tech Lead - Data & AI.

⛳️ Requirements

• Bachelor’s degree in Computer Science or a related discipline.

• Over 6 years of experience in software engineering.

• More than 2 years of experience in developing LLM-powered systems in production settings.

• Proficient in Python in a serverless environment, with a preference for AWS.

• Familiarity with infrastructure as code and CI/CD methodologies.

• Practical experience in constructing multi-agent systems using CrewAI or other frameworks such as LangGraph, OpenAI Agents SDK, Google ADK, or AWS Bedrock AgentCore.

• Experience with tool calling, structured outputs, RAG, and MCP.

• Knowledge in building evaluation and observability for LLM systems, including golden datasets, automated graders, and tracing.

• Capability to elucidate probabilistic systems to business stakeholders.

• Candidates must reside within the United States.

• Must have existing authorization to work in the United States.

• Successful completion of identity and background verification is required.

• Nice-to-have: experience in insurtech, MGA, carrier, healthcare, financial services, or other regulated sectors.

• Nice-to-have: experience managing sensitive data in compliance with HIPAA, SOC 2, or similar standards.

• Nice-to-have: familiarity with Salesforce, Athena, multi-model cost optimization, OpenTelemetry, startups, or high-growth environments.

🏝️ Benefits

• Fully distributed remote team operating across all continental US time zones.

• Comprehensive medical, dental, and vision insurance.

• 20 vacation days annually.

• 9 federal holidays off each year.

• Parental Leave policy.

• Pre-tax 401k contribution options available.

• Health Savings Account (HSA) with compatible health plans.

• FREE: Health Advocate services.

• FREE: Telehealth Membership.

• FREE: OneMedical Account.

• Opportunities for domestic travel for company offsites and team alignment.