TU Berlin

Quality and Usability Lab18_01_2021_Mir

Inhalt des Dokuments

zur Navigation

Evaluation of a Chatbot

Location:  Zoom link (Please ask Saman Zadtootaghaj for access)  

Date/Time: 18.01.2021, 15:00-15:30 

SPEAKER:  Aamir Suhial Mir (TU Berlin)

Abstract: The popularity and adoption of chatbots have risen significantly over the years.  Chatbots are transforming the way people interact with the machines. Although chatbot technologies existed since the  1960s  there is still ample scope for improvements and research. This thesis describes the design, implementation and evaluation of a chatbot that uses different language capabilities into a single model (CoQA-> Multi-Turn Question Answering; PersonaCHAT -> chitchat; SQUAD 2.0 -> general question answering). The chatbot is capable of answering questions on any given article in a Wikipedia. The evaluation of a chatbot is accomplished using a questionnaire recommended by ITU and prof. Sebastian Moller. The evaluation focuses on the quality of user satisfaction (QoS), quality cost, task completion and the quantitative analysis of the different correlations.

Navigation

Direktzugang

Schnellnavigation zur Seite über Nummerneingabe