
Senior Software Engineer – AI Innovation
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Florida, +1 more location.
• Design and deliver multi-step agentic systems (planner/executor, tool-using, multi-agent, human-in-the-loop) that automate KYB, underwriting, case review, and risk monitoring workflows.
• Architect agent graphs using LangGraph or similar frameworks, ensuring explicit state, durable execution, retries, and safe fallbacks.
• Develop and enhance the retrieval layer that supports agents, including strategies for chunking, hybrid search, reranking, and grounded citation across business filings, IRS records, bank data, and Worth’s SMB graph.
• Take ownership of the eval stack: golden sets, offline regression suites, LLM-as-judge, online A/B and shadow evaluations, and red-teaming to address jailbreaks, prompt injection, and PII leakage.
• Integrate agents into production systems through well-typed tools, MCP servers, and existing services.
• Lead production MLOps for agents, including deployment, versioning, traffic shaping, cost/latency budgets, observability, and on-call playbooks for agent-related incidents.
• Collaborate with security, compliance, and legal teams to ensure agents adhere to SOC 2, GDPR, CCPA, and fair-lending standards.
• Transform ambiguous product initiatives into specific agent designs, prototypes, and delivered features.
• Mentor engineers throughout the organization on agent patterns, prompt engineering best practices, evaluation discipline, and LLM failure modes.
• Stay informed about new models, frameworks, and patterns, bringing back successful implementations for production use.
• Work closely with the Chief AI Officer, applied scientists, product teams, and platform teams.
• Achieve success metrics related to agent quality, production reliability, velocity, risk posture, and the overall adoption of engineering practices and tools across the organization.
• 8+ years of professional software engineering experience, with a minimum of 2 years focused on building production LLM or agentic systems (not just notebooks or demos).
• Strong software engineering background - including front-end development, APIs, asynchronous patterns, queues, databases, and understanding failure modes in distributed systems.
• Proven ownership of significant features or subsystems in production environments.
• Demonstrated experience in mentoring junior engineers and enhancing team quality standards.
• Proven experience with event-driven systems: enrichment, retries, dead-lettering, and backpressure management.
• Experience overseeing containerized applications in Kubernetes, EKS, ArgoCD, operators, and Kustomize.
• Deep, hands-on expertise with at least one modern agent framework (LangGraph is strongly preferred) and a proven record of deploying agents that operate reliably, fail gracefully, and recover efficiently.
• Practical experience with evaluations — you’ve constructed golden sets, conducted offline and online evaluations, and utilized the results to inform ship/no-ship decisions.
• Fluency in production MLOps: you’ve deployed LLM workloads under real constraints of latency, cost, and reliability, and you track what you ship effectively.
• Strong proficiency in Python; comfortable with TypeScript / Node.js for integration with Worth’s services.
• Effective communicator - capable of articulating agent trade-offs to product, security, and customers without ambiguity.
• Operates with a sense of extreme ownership in dynamic, fast-paced environments. Eager to collaborate with a team that values “One Team,” “Extreme Ownership,” and “Create Raving Fans.”
• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA)
• Life Insurance
• Flexible Paid Time Off
• 9 paid Holidays
• Family Leave
• Remote work options
• Hybrid work available (for Orlando Associates)
• Complimentary Food & Snacks (Orlando)
• Wellness Resources
World Vision
FICO
Guidehouse
Workiva
Get handpicked remote jobs straight to your inbox weekly.