TU Berlin

Quality and Usability LabPublications

Inhalt des Dokuments

zur Navigation

Subject-based Usability Evaluation Methods - Publications

go back to project page

Evaluating Interactions with Spoken Dialogue Telephone Services
Zitatschlüssel moeller2008a
Autor Möller, Sebastian
Buchtitel Recent Trends in Discourse and Dialogue
Seiten 69–100
Jahr 2008
ISBN 978-1-4020-6820-1
Online ISBN 978-1-4020-6821-8
Adresse Dordrecht, Netherlands
Herausgeber Dybkjaer, Laila and Minker, Wolfgang
Verlag Springer
Zusammenfassung The quality experienced during the interaction with telephone-based spoken dialogue services results from a perception and judgement process. As a consequence, quality has to be measured in a subjective way, with the help of human test persons. To complement subjective quality judgements, parameters can be logged which quantify the flow of the interaction, the behaviour of the user and the system, and the performance of individual system modules during the interaction. Although such parameters are not directly linked to the quality perceived by the user, they provide useful information for system development, optimisation, and maintenance. This chapter presents standardised methods for both measurement approaches. Firstly, a brief overview of subjective evaluation experiments is provided, following Recommendation P.851 issued by the International Telecommunication Union. Secondly, a collection of parameters is presented which has proven to be useful for system design. An initial evaluation study in is described which shows that the parameters correlate only weakly with subjective judgements; thus, both types of evaluation provide complementary types of information. Linear regression models may be used to predict subjective judgements from interaction parameters, but their prediction accuracy is still limited.
Link zur Publikation Download Bibtex Eintrag

go back to project page



Schnellnavigation zur Seite über Nummerneingabe