Subjective assessment and instrumental prediction of mobile online gaming on the basis of perceptual dimensions
The assessment of the perceived quality of the user (Quality of Experience) of pure audio and video material differs in many ways from the quality of computer games. The later possess a variety of factors due to their interactive nature. Not only factors of complex and innovative game systems have an impact on the QoE, but also the players themselves. A quality judgment, that results by comparing the expected and perceived composition of an entity, depends highly on the preferences, expectations and abilities of the player.
In this still young area of research standard methods for determining the QoE are not directly applicable. This is apparent since in a task oriented human-computer interaction the goal should be achieved with minimal effort. However in a game the player exerts an effort in order to influence the outcome and thereby feels emotionally attached. Thus new concepts such as immersion and flow, a state of happiness while being in an equilibrium between competence and challenge, appear.
An analysis of the gaming market shows, that the proportion of mobile games has risen sharply in recent years. Mobile games are special in a sense that mobile devices such as smartphones or tablets were originally not designed for games and are therefore not optimally adapted to them. This also applies to the new concept of cloud gaming, where the entire game is executed on a server and only the video and audio material is transferred to the end user.
Aim of the project
The aim of this research project is to develop methods to assess the QoE of mobile games. In addition, based on a database containing subjective quality judgments, a model similar to the well known E-model should be constructed to predict the QoE. The following concrete steps are planned for this purpose:
- Set up and modification of a testbed for conducting experiments including a cloud gaming system for mobile games
- Development of a classification of games to choose representative games and identify system and user factors
- Building a questionnaire covering a large space of relevant quality dimensions
- Identification of quality-relevant perceptual dimensions and analysis of their impact on the overall quality
- Analyzing the performance of current objective metrics which were proposed for different contents and services in mobile gaming
- Building a QoE model based on game, system and network characteristics as well as user and context factors
|Project Number:||MO 1038/21-1|
List of Publications
|Author||Schmidt, Steven and Zadtootaghaj, Saman and Möller, Sebastian|
|Title of Book||2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX)|
|Abstract||Subjective tests to assess the Quality of Experience (QoE) of gaming services are necessary to enable service providers to ensure the satisfaction of their customers. Since gaming is an interactive activity, interactive tests are typically conducted to measure the full spectrum of the player experience. However, carrying out such tests is expensive and time-consuming. Furthermore, the results can be influenced by the behavior and abilities of participants. For this reason, it is of high interest whether such interactive tests can be partially replaced with passive viewing-and-listening tests. In this paper, we present a comparison of an interactive gaming test with passive tests using two different durations. To investigate the differences between the test paradigms, we assessed the overall quality, the video quality and the reactiveness of the game as well as other player experience aspect for different frame rates and bit rates. Results show that once certain requirements are fulfilled, passive tests offer indeed a valuable quality assessment method. However, if the duration of the presented video material is too short, the passive test overestimated the gaming and video quality. Furthermore, we show that the player performance has no impact on the video quality ratings.|