U

Upgrade

Offers fixed-rate loans, cards, BNPL

AI Experience Engineer - Conversational AI

AI Application EngineeringUpdated on Nov 10
Full-timeRemote in Canada

About the Job

Requirements

  • Have 3–5 years of frontend software engineering experience, or equivalent experience in solutions engineering, conversational AI, or technical product roles.
  • Have working knowledge of how large language model agents behave, including instructions, tool calls, knowledge retrieval, and their failure modes.
  • Have experience building evaluations for non-deterministic systems, including test sets, simulations, large language model-as-judge evaluations, and regression gates.
  • Be able to read API specifications, work with backend engineers on REST and GraphQL integrations, and reason about authorization and permission scopes.
  • Have working knowledge of JavaScript or TypeScript and be able to build and maintain coded journeys and integrate APIs within conversational AI platforms.
  • Understand operations procedures, review transcripts, attend to tone, and measure success by whether the customer's problem is solved.
  • Have experience with production rollouts, monitoring, log analysis, and incident response.
  • Have clear writing skills and be able to work with non-engineers in operations, compliance, and legal.

Responsibilities

  • Design and build Sierra journeys in Agent Studio for chat, voice, and email, from discovery with operations through production rollout.
  • Review transcripts, recordings, and analytics every week, identify where conversations fail or transfer, and ship fixes to journey logic, instructions, and knowledge.
  • Map unhappy paths, including failed payments, mismatched identity, delinquent accounts, and unsupported requests, and ensure each ends in a correct answer or a clean handoff.
  • Own containment and customer satisfaction targets for each journey, run staged rollouts from 1% to 100%, and prioritize work that most improves those metrics.
  • Work with product groups, including Personal Loans, Card, buy now, pay later, and Deposits, to scope new journeys, keep journeys current as products change, and define the APIs the agent needs.
  • Apply tiered authentication and step-up verification, verbatim compliance language, and guardrails against hallucination and off-policy answers.
  • Design transfers to human agents in Genesys with accurate summaries and authentication context.
  • Build simulation and regression suites so each journey change ships with evidence that existing behavior was not broken.
  • Monitor latency, errors, and drop-offs in Sumo Logic and Grafana, and own the alerts.
  • Tune voice latency, filler phrases, interruptions, personality, and tone.
  • Serve as the technical owner for the Sierra relationship, escalate platform issues, and shape roadmap requests.
  • Own the full lifecycle of customer journeys with Upgrade's AI agent across chat, voice, and email, including creation, optimization, edge-case handling, and containment growth.
  • Build journeys in Sierra's no-code tooling and partner with Upgrade product groups to bring servicing flows to the agent.
  • Own a portfolio of journeys across Personal Loans, Card, buy now, pay later, home equity lines of credit, and Deposits, and help set standards for building, testing, and shipping AI experiences.

Desired Qualifications

  • Hands-on experience with Sierra Agent Studio or a comparable no-code agent platform such as Decagon, Ada, Kore.ai, Google Contact Center AI, Amazon Lex, or Amazon Connect.
  • Voice AI experience, including speech-to-text, text-to-speech, latency tuning, and barge-in handling.
  • Experience with contact center systems such as Genesys and agent handoff design.
  • Background in fintech or another regulated industry, including familiarity with UDAAP, FDCPA, TCPA, PCI, or SOC 2.
  • Conversation design or user experience writing experience.

About the Company

Upgrade

Offers fixed-rate loans, cards, BNPL

Upgrade is a US consumer fintech that provides affordable and responsible credit and everyday banking services to mainstream consumers. Its products include fixed-rate personal loans, the Upgrade Card and other cash-back cards, Rewards Checking with a debit card, auto and home-improvement financing, and Flex Pay buy now, pay later at merchant checkouts. Customers fund these products through interest, fees, and card interchange, with backing from partner banks and asset-backed securitizations, and Upgrade is expanding funding by applying to form Upgrade Bank. Unlike apps that only offer one product, Upgrade combines lending, banking, and education tools in one platform to help people manage debt and build credit, aiming to widen access to affordable credit and everyday banking.

Company size
1,001-5,000
Company stage
Series G
Total funding
$712M
Headquarters
San Francisco, CA
Founded
2016

Recently Posted Jobs

Explore more opportunities at Upgrade

See more jobs