
Senior Software Engineer – Applied AI
Posted Jul 15

Posted Jul 15
This is a fully remote position, open to applicants in Oklahoma.
• Develop and troubleshoot code on a live, real-time voice pipeline where both latency and accuracy directly impact the user experience.
• Create control systems for LLMs, including guardrails, budgets, watchdogs, and safe fallback mechanisms.
• Construct and manage LLM evaluation and batch-analysis pipelines.
• Oversee traditional ML workflows from data collection to scheduled production inference.
• Diagnose production issues from metric anomalies to their root causes, including gathering evidence when the issue originates from a vendor.
• Over 7 years of experience in building and maintaining production backend systems, with a strong foundation in general-purpose programming skills (our primary language is Python).
• Proficient in managing distributed systems in the cloud; comfortable with debugging from telemetry to root causes.
• Practical production experience with LLMs or generative AI (regardless of provider or framework), along with the discernment to recognize when not to utilize a model.
• Solid understanding of the traditional machine learning lifecycle (you implement production solutions; publishing is not required).
• Methodical approach in a regulated environment: making small, reviewable changes and meticulously managing sensitive data.
• Health insurance
• Flexible work arrangements
Huron
Capital One
Get handpicked remote jobs straight to your inbox weekly.