Diagnostic Markers of User Experience, Play, and Learning for Digital Serious Games: A Conceptual Framework Study

Abstract

Background: Serious games for medical education have seen a resurgence in recent years, partly due to the growth of the video game industry and the ability of such games to support learning achievements. However, there is little consensus on what the serious and game components in a serious game are composed of. As a result, electronic learning (e-learning) and medical simulation modules are sometimes mislabeled as serious games. We hypothesize that one of the main reasons is the difficulty for a medical educator to systematically and accurately evaluate key aspects of serious games.

Objective: This study aimed to identify markers that can evaluate serious games and distinguish between serious games, entertainment games, and e-learning.

Methods: Jabareen’s eight-phase framework-building procedure was used to identify the core markers of a serious game. The procedure was modified slightly to elicit “diagnostic criteria” as opposed to its original purpose of a conceptual framework. Following the identification of purported markers, the newly developed markers were tested on a series of freely available health care serious games—Dr. Game Surgeon Trouble, Staying Alive, and Touch Surgery—and the results were compared to the published test validity for each game.

Results: Diagnostic criteria for serious games were created, comprising the clusters of User Experience (UX), Play, and Learning. Each cluster was formed from six base markers, a minimum of four of which were required for a cluster to be considered present. These criteria were tested on the three games, and Dr. Game Surgeon Trouble and Staying Alive fit the criteria to be considered a serious game. Touch Surgery did not meet the criteria, but fit the definition of an e-learning module.

Conclusions: The diagnostic criteria appear to accurately distinguish between serious games and mediums commonly misidentified as serious games, such as e-learning modules. However, the diagnostic criteria do not determine if a serious game will be efficacious; they only determine if it is a serious game. Future research should include a much larger sample of games designed specifically for health care purposes.