
AI Experience Engineer β Conversational AI
Posted Oct 14

Posted Oct 14
This is a fully remote position, open to applicants in Canada.
β’ Take charge of the complete lifecycle of customer interactions with Upgrade's AI agent through chat, voice, and email.
β’ Create and develop Sierra journeys in Agent Studio, from the discovery phase to production implementation.
β’ Conduct weekly reviews of transcripts, recordings, and analytics; pinpoint failures or transfers and implement solutions to journey logic, instructions, and knowledge.
β’ Identify and map out unhappy paths to guarantee accurate responses or seamless human transitions.
β’ Assume responsibility for containment and CSAT targets, execute staged rollouts from 1% to 100%, and prioritize enhancements.
β’ Collaborate with product teams across Personal Loans, Card, BNPL, and Deposits to outline and sustain journeys while defining necessary APIs.
β’ Implement tiered authentication, step-up verification, compliance language, and establish guardrails for hallucination/off-policy instances.
β’ Design human-agent transfer processes within Genesys, ensuring precise summaries and authentication context.
β’ Develop simulation and regression suites for modifications in journeys.
β’ Track latency, errors, and drop-offs in SumoLogic and Grafana while managing alerts.
β’ Optimize voice interactions, focusing on latency, filler phrases, interruptions, personality, and tone.
β’ Serve as Upgrade's technical lead for the Sierra relationship, addressing platform issues and influencing roadmap requests.
β’ 3β5 years of experience in Frontend Software Engineering, or comparable experience in Solutions Engineering, Conversational AI, or Technical Product roles.
β’ Proficient understanding of LLM agent behavior, including instructions, tool calls, knowledge retrieval, and potential failure points.
β’ Experience in constructing evaluations for non-deterministic systems, including test sets, simulations, LLM-as-judge, and regression gates.
β’ Sufficient technical depth to interpret API specifications, collaborate with backend engineers on REST and GraphQL integrations, and evaluate authorization and permission scopes.
β’ Familiarity with JavaScript/TypeScript, with the capability to create and maintain coded journeys and integrate APIs within conversational AI platforms.
β’ Possess a product and customer-oriented mindset: understanding operations procedures, analyzing transcripts, caring about tone, and measuring success based on the resolution of customer issues.
β’ Demonstrated ownership in production environments: managing rollouts, monitoring, log analysis, and incident response.
β’ Strong written communication skills and the ability to collaborate effectively with non-engineering personnel in operations, compliance, and legal.
β’ Competitive salary ($140K-$180K CAN).
β’ Stock option plan.
β’ Fully paid medical, dental, and vision insurance coverage.
β’ Flexible paid time off (PTO).
β’ Opportunities for professional development and growth.
β’ Paid parental leave.
β’ Health and wellness initiatives.
Fortrea
BrightSpring Health Services
Alpaca Health
Alpaca Health
Get handpicked remote jobs straight to your inbox weekly.