TU Berlin

Quality and Usability Lab11_05_2020_Naderi

Inhalt des Dokuments

zur Navigation

Transformation of Mean Opinion Scores to Avoid Misleading of Ranked based Statistical Techniques

Location:  TEL, Room Auditorium 3 (20th floor), Ernst-Reuter-Platz 7, 10587 Berlin  

Date/Time: 11.05.2020, 14:15-15:00 

SPEAKER: Dr.-Ing Babak Naderi (TU Berlin)

Abstract: The rank correlation coefficients and the ranked-based statistical tests (as a subset of non-parametric techniques) might be misleading when they are applied to subjectively collected opinion scores.  Those techniques assume that the data is measured at least at an ordinal level and define a sequence of scores to represent a tied rank when they have precisely an equal numeric value. In this presentation, we show that the definition of tied rank, as mentioned above, is not suitable for Mean Opinion Scores (MOS) and might be misleading conclusions of rank-based statistical techniques.

Furthermore, we introduce a method to overcome this issue by transforming the MOS values considering their 95% Confidence Intervals.  The rank correlation coefficients and ranked-based statistical tests can then be safely applied to the transformed values.

We also provide open-source software packages in different programming languages to utilize the application of our transformation method in the quality of experience domain.



Schnellnavigation zur Seite über Nummerneingabe