AI Research and BOOK design

Caiya:Enhancing User Experience in
E-commerce Conversational AI

Caiya:Enhancing User Experience in
E-commerce Conversational AI

Caiya:Enhancing User Experience in
E-commerce Conversational AI

Institution

THA

THA

THA

ROLE

Lead UX Researcher
System Architect

Lead UX Researcher
System Architect

EXPERTISE

CAS Design,
Trust calibration

CAS Design,
Trust calibration

YEAR

2025

2025

2025

  1. Project description

Current e-commerce chatbots often suffer from "conversational coldness" and high friction during complex tasks. This research shifts the focus from purely verbal logic to Visual Interaction Cues (VICs) and Avatar Embodiment.

The goal

Transform technical AI capabilities into predictable business value by examining how visual cues impacts user performance and emotional comfort during tracking and voucher redemption flows

  1. Research Questions

Precision-Led Inquiry: Defining the Scope of AI UX.

RQ1 (Functional):

How do avatar embodiment and VICs affect task-oriented experience—specifically clarity and task efficiency—in e-commerce AI?

How do avatar embodiment and VICs affect task-oriented experience—specifically clarity and task efficiency—in e-commerce AI?

RQ2 (Emotional):

How do these elements influence emotion-oriented metrics such as satisfaction, trust, and emotional comfort?

Formulated 5 hypotheses targeting both functional performance and emotional resonance.

Formulated 5 hypotheses targeting both functional performance and emotional resonance.

  1. Experiment Design

Experimental Framework

Conducted a rigorous 2×2 between-subjects experiment with 32 participants across four high-fidelity prototype variations (VA, VB, OA, OB)

Wrong Path Design

To avoid "process theater," I embedded a simulated system failure (undisclosed voucher entry error). This allowed for the authentic observation of user frustration and recovery behavior in "non-ideal" scenarios, a key senior-level signal for risk reduction

Technical Realization: LLM-Integrated High-Fidelity Prototyping

Moving beyond static mockups, I architected a functional conversational system using Voiceflow integrated via API with GPT-3.5 Turbo.

  1. The Validation Framework

Specialized Benchmarking

The CUQ

The CUQ

Utilized the CUQ (Chatbot Usability Questionnaire) developed by Ulster University

High-Fidelity Behavioral Tracking

Task Duration and Error Rate

Task Duration and Error Rate

Utilized the CUQ (Chatbot Usability Questionnaire) developed by Ulster University

Qualitative insight discovering

Think Aloud

Think Aloud

Conducted direct observation and Think Aloud protocols during an undisclosed the "Wrong Path"

  1. Key Results

Recruited 32 participants via random intercept surveys in naturalistic settings (university cafeteria and library) to capture authentic, spontaneous user behavior

Recruited 32 participants via random intercept surveys in naturalistic settings (university cafeteria and library) to capture authentic, spontaneous user behavior

+24% Task Efficiency

Systemic visual interaction cues (VICs) significantly accelerated task duration and reduced interaction friction.

-65% Error Reduction

High user satisfaction ratings and positive reviews highlight the app's intuitive interface and powerful AI capabilities.

Affective Nuance

Avatar embodiment significantly enhanced initial "welcomingness" (p=.008) but showed a "ceiling effect" on establishing long-term trust.

Cognitive Threshold

Identified a "visual noise" limit where excessive scaffolding without precise verbal guidance increases load during error recovery.

6 . Retrospective: Learnings & Growth

Advanced Trust Calibration

Moving toward 7-point measurement scales and high-stakes tasks to detect nuanced shifts beyond the current "ceiling effect"

Adaptive Interaction Logic:

Transitioning from static scaffolding to adaptive AI interfaces that dynamically balance visual richness with verbal guidance

Inclusive System Scaling

Prioritizing platform-neutral UI and demographic parity to ensure interaction robustness across both digital-native and novice populations

Create a free website with Framer, the website builder loved by startups, designers and agencies.