AI Experience Engineer – Conversational AI

atUpgrade, Inc.RemoteCA flagCanadaFull-timeUncategorizedMid-levelSeniorC$140k – C$180k/year

Posted Oct 14

This is a fully remote position, open to applicants in Canada.

πŸ“‹ Description

β€’ Take charge of the complete lifecycle of customer interactions with Upgrade's AI agent through chat, voice, and email.

β€’ Create and develop Sierra journeys in Agent Studio, from the discovery phase to production implementation.

β€’ Conduct weekly reviews of transcripts, recordings, and analytics; pinpoint failures or transfers and implement solutions to journey logic, instructions, and knowledge.

β€’ Identify and map out unhappy paths to guarantee accurate responses or seamless human transitions.

β€’ Assume responsibility for containment and CSAT targets, execute staged rollouts from 1% to 100%, and prioritize enhancements.

β€’ Collaborate with product teams across Personal Loans, Card, BNPL, and Deposits to outline and sustain journeys while defining necessary APIs.

β€’ Implement tiered authentication, step-up verification, compliance language, and establish guardrails for hallucination/off-policy instances.

β€’ Design human-agent transfer processes within Genesys, ensuring precise summaries and authentication context.

β€’ Develop simulation and regression suites for modifications in journeys.

β€’ Track latency, errors, and drop-offs in SumoLogic and Grafana while managing alerts.

β€’ Optimize voice interactions, focusing on latency, filler phrases, interruptions, personality, and tone.

β€’ Serve as Upgrade's technical lead for the Sierra relationship, addressing platform issues and influencing roadmap requests.


⛳️ Requirements

β€’ 3–5 years of experience in Frontend Software Engineering, or comparable experience in Solutions Engineering, Conversational AI, or Technical Product roles.

β€’ Proficient understanding of LLM agent behavior, including instructions, tool calls, knowledge retrieval, and potential failure points.

β€’ Experience in constructing evaluations for non-deterministic systems, including test sets, simulations, LLM-as-judge, and regression gates.

β€’ Sufficient technical depth to interpret API specifications, collaborate with backend engineers on REST and GraphQL integrations, and evaluate authorization and permission scopes.

β€’ Familiarity with JavaScript/TypeScript, with the capability to create and maintain coded journeys and integrate APIs within conversational AI platforms.

β€’ Possess a product and customer-oriented mindset: understanding operations procedures, analyzing transcripts, caring about tone, and measuring success based on the resolution of customer issues.

β€’ Demonstrated ownership in production environments: managing rollouts, monitoring, log analysis, and incident response.

β€’ Strong written communication skills and the ability to collaborate effectively with non-engineering personnel in operations, compliance, and legal.


🏝️ Benefits

β€’ Competitive salary ($140K-$180K CAN).

β€’ Stock option plan.

β€’ Fully paid medical, dental, and vision insurance coverage.

β€’ Flexible paid time off (PTO).

β€’ Opportunities for professional development and growth.

β€’ Paid parental leave.

β€’ Health and wellness initiatives.

People also viewed

Fortrea9 hours ago

Start-Up Maintenance Specialist, DACH Expertise

CH flagSwitzerland OnlyFull-timeUncategorized
ApplyView job
BrightSpring Health Services9 hours ago

Virtual BCBA, Board Certified Behavior Analyst

US flagUnited States OnlyPart-timeUncategorized$55 – $60/hour
ApplyView job
Alpaca Health9 hours ago

Intake Coordinator

US flagUnited States OnlyPart-timeUncategorized$18 – $25/hour
ApplyView job
Alpaca Health9 hours ago

Intake Coordinator

US flagUnited States OnlyFull-timeUncategorized$18 – $25/hour
ApplyView job
Humana9 hours ago

Clinical Innovation Delivery Principal

US flagUnited States OnlyFull-timeUncategorized$138.9k – $191k/year
ApplyView job
TAG - The Aspen Group9 hours ago

Unapplied Cash Associate

US flagUnited States OnlyFull-timeUncategorized$21 – $25/hour
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers