
Senior AI Engineer
Posted Oct 30

Posted Oct 30
This is a fully remote position, open to applicants in Illinois.
• Take full ownership of the end-to-end delivery of LLM-powered systems utilizing Python and TypeScript, addressing ambiguous customer challenges from initial stages to production operation.
• Collaborate with product managers and data scientists to define and scope customer issues.
• Establish evaluations and guardrails, set release gates, production signals, and conduct historical claims simulations.
• Enhance team practices for agentic coding tools, which include specifications, instruction files, hooks, permission policies, and code review standards.
• Develop NLP pipelines that transform unstructured claims data into structured data actionable for customers.
• Construct and maintain robust, event-driven, multi-tenant systems with agents integrated as steps in deterministic workflows.
• Design failure modes, replay semantics, and cost profiles.
• Manage tracing and auditing to ensure that model calls and agent steps can be accurately reconstructed and sourced.
• Set privacy and security standards, covering tenant isolation, least-privilege access, redaction, retention, and controls over model-provider data.
• Write complex system design documents and review the designs and code of other engineers.
• Provide mentorship to engineers within the team.
• Engage in a shared on-call rotation.
• Deliver systems where model changes are evaluated and whose accuracy can be clearly demonstrated to customers.
• At least 6 years of professional software engineering experience, including the architecture and deployment of an LLM-powered system to external customers, with at least one model or prompt migration.
• Proficient in Python and TypeScript, with experience in establishing team conventions for asynchronous models, typing strictness, and testing strategies, as well as profiling and resolving performance issues.
• Proven experience in establishing evaluation and guardrail strategies for a product area, including human approval requirements and integrating production corrections back into evaluations.
• Daily practical use of agentic coding tools like Claude Code, Cursor, or GitHub Copilot, focusing on context constraints and output verification.
• Experience in designing pipelines that integrate LLMs, semantic search, and classical NLP methodologies.
• Familiarity with building durable, event-driven systems that orchestrate deterministic processes around non-deterministic model steps, which includes compensatory actions, idempotency, backpressure, and event-sourced replay.
• Skilled in data modeling and development across various database types, including relational, document, and graph databases such as PostgreSQL, MongoDB, and Neo4j.
• Experience in architecting and managing systems on Azure or AWS, including CI/CD and infrastructure as code practices.
• Hands-on familiarity with a durable workflow engine, such as Temporal or the Durable Task Scheduler.
• Experience in authoring technical design documents for systems involving multiple teams.
• Ability to communicate clearly with both technical and non-technical audiences.
• Preferred experience with React and TypeScript.
• Familiarity with agent frameworks, including LangGraph, PydanticAI, Microsoft Agent Framework, MCP, A2A, command-line tools, and microservices is an advantage.
• Experience with LLM observability and evaluation tools such as LangSmith, Arize, or Braintrust, as well as OpenTelemetry-based tracing is preferred.
• Experience in designing A/B tests for AI features is an added advantage.
• Exposure to the insurance, claims, or automotive repair industries is preferred.
• Participation in a shared on-call rotation is mandatory.
• A video interview is required; candidates must not use generative AI or automated assistance during interviews unless explicitly permitted.
• 401K Match
• Paid time off
• Annual Incentive Plan Performance Bonus
• Comprehensive health insurance
• Adoption Assistance
• Tuition Reimbursement
• Wellness Programs
• Stock Purchase Plan options
• Employee Resource Groups
Warner Music Group
Huron
Stefanini Brasil
Get handpicked remote jobs straight to your inbox weekly.