Inhalt des Dokuments
Evaluation of a Chatbot
Location: Zoom link (Please ask Saman Zadtootaghaj for access)
Date/Time: 18.01.2021, 15:00-15:30
SPEAKER: Aamir Suhial Mir (TU Berlin)
Abstract: The popularity and adoption of chatbots have risen significantly over the years. Chatbots are transforming the way people interact with the machines. Although chatbot technologies existed since the 1960s there is still ample scope for improvements and research. This thesis describes the design, implementation and evaluation of a chatbot that uses different language capabilities into a single model (CoQA-> Multi-Turn Question Answering; PersonaCHAT -> chitchat; SQUAD 2.0 -> general question answering). The chatbot is capable of answering questions on any given article in a Wikipedia. The evaluation of a chatbot is accomplished using a questionnaire recommended by ITU and prof. Sebastian Moller. The evaluation focuses on the quality of user satisfaction (QoS), quality cost, task completion and the quantitative analysis of the different correlations.