Page 1 |
Save page Remove page | Previous | 1 of 161 | Next |
|
small (250x250 max)
medium (500x500 max)
Large (1000x1000 max)
Extra Large
large ( > 500x500)
Full Resolution
All (PDF)
|
This page
All
|
USER MODELING FOR HUMAN-MACHINE SPOKEN INTERACTION AND
MEDIATION SYSTEMS.
by
JongHo Shin
A Dissertation Presented to the
FACULTY OF THE GRADUATE SCHOOL
UNIVERSITY OF SOUTHERN CALIFORNIA
In Partial Fulfillment of the
Requirements for the Degree
DOCTOR OF PHILOSOPHY
(COMPUTER SCIENCE)
May 2008
Copyright 2008 JongHo Shin
Object Description
| Title | User modeling for human-machine spoken interaction and mediation systems |
| Author | Shin, JongHo |
| Author email | jonghoshin@hotmail.com |
| Degree | Doctor of Philosophy |
| Document type | Dissertation |
| Degree program | Computer Science |
| School | Viterbi School of Engineering |
| Date defended/completed | 2007-12-03 |
| Date submitted | 2008 |
| Restricted until | Restricted until 28. Feb 2010. |
| Date published | 2010-02-28 |
| Advisor (committee chair) | Narayanan, Shrikanth S. |
| Advisor (committee member) |
Neumann, Ulrich Kuo, C.-C. Jay Georgiou, Panayiotis G. |
| Abstract | One of the most fundamental challenges in building speech-enabled systems is knowing the users. This information about users is captured in what is usually called a user model. This study investigates user models for speech-enabled systems, which include both human-machine spoken interaction and machine-mediated human-human interaction systems. Because of the intrinsic error-prone property of statistical processing of human speech technology, errors are inevitable during the interactions to/through the speech-enabled systems. In this regard, this dissertation studies four different user models under uncertain error conditions of spoken dialog systems and spoken mediation systems. The user models were driven based on the data of mixed-initiative spoken dialogs, and multimodal (speech and visual) interactions of a spoken mediation system. The user models of this dissertation aims to contribute to accelerate the optimization of dialog management of the speech-enabled systems.; The addressed user models are about: (1) user behaviors under error conditions of a spoken dialog system; (2) multimodal user behaviors under uncertainty in two persons communication using a speech-to-speech translation system; (3) user behavioral changes over time in uncertain communication when using a multimodal interface of a speech-to-speech translation system; and (4) user level of tolerating errors implemented with a dynamic Bayesian network and possible speech Accommodation between two interlocutors. The model of dynamic Bayesian network was validated offline with the multimodal interaction data of a speech-to-speech translation system, and online with agent feedback used in a multimodal interface of a speech-to-speech translation system. |
| Keyword | user modeling; spoken dialog system; spoken mediation system; analysis of user behaviors; interactive computer system; speech recognition |
| Language | English |
| Part of collection | University of Southern California dissertations and theses |
| Publisher (of the original version) | University of Southern California |
| Place of publication (of the original version) | Los Angeles, California |
| Publisher (of the digital version) | University of Southern California. Libraries |
| Type | texts |
| Legacy record ID | usctheses-m1031 |
| Contributing entity | University of Southern California |
| Rights | Shin, JongHo |
| Repository name | Libraries, University of Southern California |
| Repository address | Los Angeles, California |
| Repository email | cisadmin@dots.usc.edu |
| Filename | etd-Shin-20080229 |
| Archival file | uscthesesreloadpub_Volume40/etd-Shin-20080229.pdf |
Description
| Title | Page 1 |
| Contributing entity | University of Southern California |
| Repository email | cisadmin@dots.usc.edu |
| Full text | USER MODELING FOR HUMAN-MACHINE SPOKEN INTERACTION AND MEDIATION SYSTEMS. by JongHo Shin A Dissertation Presented to the FACULTY OF THE GRADUATE SCHOOL UNIVERSITY OF SOUTHERN CALIFORNIA In Partial Fulfillment of the Requirements for the Degree DOCTOR OF PHILOSOPHY (COMPUTER SCIENCE) May 2008 Copyright 2008 JongHo Shin |
