A Review of Adaptable Serious Games Applied to Professional Training
Abstract
Serious Games have been used in professional training to increase employee engagement and improve training initiatives. This review intends to identify the application of Serious Games in professional training and how these games have been developed, evaluated, and adapted to relate to the learning outcomes. It aims to map the use of Serious Games in professional training, verifying which forms of adaptation are used, learning outcomes, and models and frameworks of Serious Games that include game elements. Different learning outcomes associated with Serious Games were identified, in the general context and professional training, with knowledge acquisition being the most investigated result and questionnaires the most used type of assessment. It was found that several technologies are used in the adaptation of Serious Games. This literature review highlighted gaps in Serious Games research, especially in adaptive games applied in the context of professional training, such as the absence of frameworks for adaptive Serious Games and the lack of a framework for Serious Games that relates game elements to learning outcomes.
Downloads
References
Abt, C. C. (1987). Serious games. Lanham, MD: University press of America.
Almeida, P., Pedro, L., Moita, M., Magalhães, R., Santos, A., & Moreira, L. (2011). Serious Games as an onboarding organizational tool for new employees.. 6th Iberian Conference on Information Systems and Technologies (CISTI 2011), IEEE, Chaves, Portugal, 1–6. https://ieeexplore.ieee.org/abstract/document/5974334/
Amory, A. (2007). Game object model version II: a theoretical framework for educational game development. Educational Technology Research and Development: ETR & D, 55(1), 51–77. https://doi.org/10.1007/s11423-006-9001-x
Amory, A., Naicker, K., Vincent, J., & Adams, C. (1999). The use of computer games as an educational tool: identification of appropriate game types and game elements. British Journal of Educational Technology: Journal of the Council for Educational Technology, 30(4), 311–321. https://doi.org/10.1111/1467-8535.00121
Andreoli, R., Corolla, A., Faggiano, A., Malandrino, D., Pirozzi, D., Ranaldi, M., Santangelo, G., & Scarano, V. (2017). A Framework to Design, Develop, and Evaluate Immersive and Collaborative Serious Games in Cultural Heritage. J. Comput. Cult. Herit., 11(1), 1–22. https://doi.org/10.1145/3064644
Arnab, S., Lim, T., Carvalho, M. B., Bellotti, F., de Freitas, S., Louchart, S., Suttie, N., Berta, R., & De Gloria, A. (2015). Mapping learning and game mechanics for Serious Games analysis. British Journal of Educational Technology: Journal of the Council for Educational Technology, 46(2), 391–411. https://doi.org/10.1111/bjet.12113
Bachvarova, Y., Bocconi, S., van der Pols, B., Popescu, M., & Roceanu, I. (2012). Measuring the Effectiveness of Learning with Serious Games in Corporate Training. Procedia Computer Science, 15, 221–232. https://doi.org/10.1016/j.procs.2012.10.074
Bahji, S. E., Lefdaoui, Y., & El Alami, J. (2011). The Learning Model S2P as a Conceptual Framework for Understanding the Serious Game. Proceedings of the 14th IASTED International Conference “Computers and Advanced Technology in Education (CATE 2011), July 11–13, Cambridge, UK, 1-5. https://www.researchgate.net/profile/Salah_Eddine_Bahji/publication/256980833_The_Learning_Model_S2P_as_a_Conceptual_Framework_for_Understanding_the_Serious_Game/links/5636 827b08aeb786b703f231/The-Learning-Model-S2P-as-a-Conceptual-Framework-for- Understanding-the-Serious-Game.pdf
Bennis, L., & Benhlima, S. (2015). Comparative study of the process model of Serious Game Design through the generic model DICE. 2015 Intelligent Systems and Computer Vision (ISCV), 1–5. https://doi.org/10.1109/ISACV.2015.7105539
Boller, S., & Kapp, K. (2017). Play to learn. Alexandria, Virginia: ATD Press.
Boyle, E. A., Connolly, T. M., Hainey, T., & Boyle, J. M. (2012). Engagement in digital entertainment games: A systematic review. Computers in Human Behavior, 28(3), 771–780. https://doi.org/10.1016/j.chb.2011.11.020
Boyle, E. A., Hainey, T., Connolly, T. M., Gray, G., Earp, J., Ott, M., Lim, T., Ninaus, M., Ribeiro, C., & Pereira, J. (2016). An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and Serious Games. Computers & Education, 94, 178–192. https://doi.org/10.1016/j.compedu.2015.11.003
Calderón, A., & Ruiz, M. (2015). A systematic literature review on Serious Games evaluation: An application to software project management. Computers & Education, 87, 396–422. https://doi.org/10.1016/j.compedu.2015.07.011
Carvalho, M. B., Bellotti, F., Berta, R., De Gloria, A., Sedano, C. I., Hauge, J. B., Hu, J., & Rauterberg, M. (2015). A theory-based activity model for Serious Games analysis and conceptual design. Computers & Education, 87, 166–181. https://doi.org/10.1016/j.compedu.2015.03.023
Coleman, T. E., & Money, A. G. (2020). Student-centred digital game-based learning: a conceptual framework and survey of state of the art. Higher Education, 79(3), 415–457. https://doi.org/10.1007/s10734-019-00417-0
de Freitas, S., & Jarvis, S. (2006). A framework for developing Serious Games to meet learner needs. The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC), 4 - 7 December, Orlando, Florida. Retrieved December 30 2021, from https://researchrepository.murdoch.edu.au/id/eprint/27662/
Donovan, L., & Lead, P. (2012). The use of Serious Games in the corporate sector. A State of the Art Report. Learnovate Centre (December 2012). Retrieved December 30, 2021 from https://www.learnovatecentre.org/wp-content/uploads/2013/06/Use_of_Serious_Games_in_the_Corporate_Sector_PRINT_FINAL.pdf
Dresch, A., Lacerda, D. P., & Júnior, J. (2020). Design Science Research: Método de Pesquisa para Avanço da Ciência e Tecnologia. Bookman Editora. Retrieved Dexember 30 2021 from https://play.google.com/store/books/details?id=M63XDwAAQBAJ
Emmerich, K., & Bockholt, M. (2016). Serious Games Evaluation: Processes, Models, and Concepts. In R. Dörner, S. Göbel, M. Kickmeier-Rust, M. Masuch, & K. Zweig (Eds.), Entertainment Computing and Serious Games: International GI-Dagstuhl Seminar 15283, Dagstuhl Castle, Germany, July 5-10, 2015, Revised Selected Papers (pp. 265–283). Springer International Publishing. https://doi.org/10.1007/978-3-319-46152-6_11
Engberg-Pedersen, A. (2017). Technologies of Experience: Harun Farocki’s Serious Games and Military Aesthetics. Boundary 2, 44(4), 155–178. Retrieved December 30, 2021 from https://read.dukeupress.edu/boundary-2/article-abstract/44/4/155/130459
Ferreira de Almeida, J. L., & dos Santos Machado, L. (2021). Design requirements for educational serious games with focus on player enjoyment. Entertainment Computing, 38, 1-11. https://doi.org/10.1016/j.entcom.2021.100413
Greitzer, F. L., Kuchar, O. A., & Huston, K. (2007). Cognitive science implications for enhancing training effectiveness in a serious gaming context. ACM Journal on Educational Resources in Computing, 7(3), 2 – es. https://doi.org/10.1145/1281320.1281322
Gunter, G. A., Kenny, R. F., & Vick, E. H. (2008). Taking educational games seriously: using the RETAIN model to design endogenous fantasy into standalone educational games. Educational Technology Research and Development: ETR & D, 56(5), 511–537. https://doi.org/10.1007/s11423-007-9073-2
Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification. 2014 47th Hawaii International Conference on System Sciences, 3025–3034. https://doi.org/10.1109/HICSS.2014.377
Hays, R. T. (2005). The effectiveness of instructional games: A literature review and discussion [Technical Report]. Retrieved December 30 from https://apps.dtic.mil/sti/pdfs/ADA441935.pdf
Huang, W.-H. D., & Tettegah, S. Y. (2014). Cognitive Load and Empathy in Serious Games: A Conceptual Framework. In J. Bishop (Eds.) Gamification for Human Factors Integration: Social, Education, and Psychological Issues (pp. 17–30). IGI Global. https://doi.org/10.4018/978-1-4666-5071-8.ch002
Jantke, K. P. (2010). Toward a taxonomy of game-based learning. 2010 IEEE International Conference on Progress in Informatics and Computing, 2, 858–862.https://doi.org/10.1109/PIC.2010.5687903
Kapp, K. M. (2012). The gamification of learning and instruction: game-based methods and strategies for training and education. New York, USA:John Wiley & Sons.
Kapp, K. M. (2013). The gamification of learning and instruction Fieldbook: Ideas into practice. New York, USA: John Wiley&Sons. https://books.google.com/books?hl=pt- BR&lr=&id=cdtnAQAAQBAJ&oi=fnd&pg=PR25&dq=%22The+gamification+of+learning+and+instruction%22&ots=lupdfvnVru&sig=qZYwN6kzW3Mwr1xXJD3oM9dNSss
Kara, N. (2021). A Systematic Review of the Use of Serious Games in Science Education. Contemporary Educational Technology, 13(2), ep295. https://doi.org/10.30935/cedtech/9608
Kiili, K., Lainema, T., de Freitas, S., & Arnab, S. (2014). Flow framework for analysing the quality of educational games. Entertainment Computing, 5(4), 367–377. https://doi.org/10.1016/j.entcom.2014.08.002
Kirkpatrick, D., & Kirkpatrick, J. (2006). Evaluating training programs: The four levels. San Francisco, California: Berrett-Koehler Publishers. https://books.google.com/books?hl=pt-BR&lr=&id=BJ4QCmvP5rcC&oi=fnd&pg=PR9&dq=%22Evaluating+Training+Programs%22&ots=Mn-0c9uZ9V&sig=VA3k33POKeyp01B5l5AqPypHbak
Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele, UK, Keele University, 33(2004), 1–26.https://www.elizabete.com.br/rs/Tutorial_IHC_2012_files/Conceitos_RevisaoSistematica_kitchenham_2004.pdf
Larson, K. (2020). Serious Games and Gamification in the Corporate Training Environment: a Literature Review. TechTrends, 64(2), 319–328. https://doi.org/10.1007/s11528-019-00446-7
Lopes, R., & Bidarra, R. (2011). Adaptivity Challenges in Games and Simulations: A Survey. IEEE Transactions on Computational Intelligence in AI and Games, 3(2), 85–99. https://doi.org/10.1109/TCIAIG.2011.2152841
Luo, L., Yin, H., Cai, W., Lees, M., & Zhou, S. (2013). Interactive scenario generation for mission- based virtual training: Interactive scenario generation. Computer Animation and Virtual Worlds, 24(3-4), 345–354. https://doi.org/10.1002/cav.1525
Marne, B., Carron, T., Labat, J., & Marfisi-Schottman, I. (2013). MoPPLiq: A Model for Pedagogical Adaptation of Serious Game Scenarios. 2013 IEEE 13th International Conference on Advanced Learning Technologies, 291–293. https://doi.org/10.1109/ICALT.2013.90
Martin, S.M., Casey, J.R and Kane, S. (2021). Serious Games in Personalized Learning – New Models for Design and Performance. New York: Routledge.
Mayer, R. E. (2014). Computer games for learning: An evidence-based approach. Cambridge, Massachusetts: MIT Press.
McMahon, M. (2009). Using the DODDEL model to teach Serious Game design to novice designers. Ascilite, 646–653.
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.412.919&rep=rep1&type=pdf
Mitgutsch, K., & Alvarado, N. (2012). Purposeful by design? A Serious Game design assessment framework. FDG ‘12: Proceedings of the International Conference on the Foundations of Digital Games, 121-28. https://doi.org/10.1145/2282338.2282364
O'Brien, H. L., & Toms, E. G. (2008). What is user engagement? A conceptual framework for defining user engagement with technology. Journal of the American society for Information Science and Technology, 59(6), 938-955. https://doi.org/10.1002/asi.20801
Pabon, L. C. (2016). Training Through Serious Games: The Relationship Between Travel Agent Engagement, Knowledge of Cruise Products and Cruise Sales. FIU Electronic Theses and Dissertations, 1-187. https://doi.org/10.25148/etd.FIDC000713
Rasim, Langi, A. Z. R., Munir, & Rosmansyah, Y. (2016). A survey on adaptive engine technology for Serious Games. AIP Conference Proceedings, 1708(1), 050003. https://doi.org/10.1063/1.4941161
Riedel, J. C., Feng, Y., Hauge, J. M. B., Hansen, P. K., & Tasuya, S. (2015). The adoption and application of Serious Games in corporate training—The case of manufacturing. 2015 IEEE International Conference on Engineering, Technology and Innovation/International Technology Management Conference (ICE/ITMC), 1–9. https://ieeexplore.ieee.org/abstract/document/7438684/
Serrano-Laguna, Á., Manero, B., Freire, M., & Fernández-Manjón, B. (2018). A methodology for assessing the effectiveness of Serious Games and for inferring player learning outcomes. Multimedia Tools and Applications, 77(2). https://doi.org/10.1007/s11042-017-4467-6
Sillaots, M. (2016, June 5). Game Elements. Retrieved December 30, 2021 from http://ludoguru.org/gameelements/GameElements.pdf
Sillaots, M., Jesmin, T., & Rinde, A. (2016). Survey for mapping game elements. Proceedings of the 10th European Conference on Game-Based Learning ECGBL, 617–626. Retrieved December 30, 2021 from https://www.researchgate.net/profile/Martin_Sillaots/publication/326837965_Survey_for_Mapping_Game_Elements/links/5b68305345851584787f278f/Survey-for-Mapping-Game-Elements.pdf
Sousa, L., Figueiredo, M., Monteiro, J., Bidarra, J., Rodrigues, J., & Cardoso, P. (2016). Developments of Serious Games in Education. In J.Rodrigues et al (Eds.) Handbook of Research on Human-Computer Interfaces, Developments, and Applications (pp. 392–419). IGI Global. https://doi.org/10.4018/978-1-5225-0435-1.ch016
Streicher, A., & Smeddinck, J. D. (2016). Personalized and Adaptive Serious Games. In R. Dörner, S. Göbel, M. Kickmeier-Rust, M. Masuch, & K. Zweig (Eds.), Entertainment Computing and Serious Games: International GI-Dagstuhl Seminar 15283, Dagstuhl Castle, Germany, July 5-10, 2015, Revised Selected Papers (pp. 332–377). Springer International Publishing. https://doi.org/10.1007/978-3-319-46152-6_14
Tahir, R., & Wang, A. I. (2018). Codifying game-based learning: The league framework for evaluation. European Conference on Games Based Learning. Academic Conferences International Limited. https://www.researchgate.net/profile/Rabail_Tahir2/publication/330009767_Codifying_Game-Based_Learning_The_LEAGUE_framework_for_Evaluation/links/5c92329192851cf0ae89fdb3/C odifying-Game-Based-Learning-The-LEAGUE-framework-for-Evaluation.pdf
Tang, S. O. T., Hanneghan, M., & Carter, C. (2013). A Platform Independent Game Technology Model for Model-Driven Serious Games Development. Electronic Journal of E-Learning, 11(1), 61–79. https://researchonline.ljmu.ac.uk/id/eprint/184/
Thillainathan, N. (2013). A Model-Driven Development Framework for Serious Games. In Informatik 2013 Doctoral Consortium, Koblenz, Germany.https://doi.org/10.2139/ssrn.2475410
Ulrich, F., & Helms, N. H. (2017). CREATING EVALUATION PROFILES FOR GAMES DESIGNED TO BE FUN: An Interpretive Framework for Serious Game Mechanics. Simulation & Gaming, 48(5), 695–714. https://doi.org/10.1177/1046878117709841
Uskov, A., & Sekar, B. (2014). Serious games, gamification and game engines to support framework activities in engineering: Case studies, analysis, classifications and outcomes. IEEE International Conference on Electro/Information Technology, 618–623. https://doi.org/10.1109/EIT.2014.6871836
van Oostendorp, H., Van der Spek, E. D., & Linssen, J. (2014). Adapting the Complexity Level of a Serious Game to the Proficiency of Players. EAI Endorsed Trans. Serious Games, 1(2), e5. https://research.tue.nl/files/42091477/sg.1.2.e5.pdf
Vermeulen, M., Guigon, G., Mandran, N., & Labat, J. (2017). Teachers at the Heart of the Learning Games Design: The DISC Model. 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT), 145–149. https://doi.org/10.1109/ICALT.2017.41
Wattanasoontorn, V., Hernández, R. J. G., & Sbert, M. (2014). Serious Games for e-Health Care. In Y. Cai & S. L. Goei (Eds.), Simulations, Serious Games and Their Applications (pp. 127–146). Springer Singapore. https://doi.org/10.1007/978-981-4560-32-0_9
Whitton, N., & Moseley, A. (2014). Deconstructing Engagement: Rethinking Involvement in Learning. Simulation and Gaming, 45, 433–449. https://doi.org/10.1177/1046878114554755
Wilson, D. W., Jenkins, J., Twyman, N., Jensen, M., Valacich, J., Dunbar, N., Wilson, S., Miller, C., Adame, B., Lee, Y.-H., Burgoon, J., & Nunamaker, J. F. (2016). Serious games: An evaluation framework and case study (Sprague R.H. & Bui T.X. (eds.); Vol. 2016-March). IEEE Computer Society. https://doi.org/10.1109/HICSS.2016.85
Wouters, P., van der Spek, E. D., & van Oostendorp, H. (2009). Current Practices in Serious Game Research: A Review from a Learning Outcomes Perspective. In T. Connolly (Eds.) Games- Based Learning Advancements for Multi-Sensory Human-Computer Interfaces: Techniques and Effective Practices (pp. 232–250). IGI Global. https://doi.org/10.4018/978-1-60566-360-9.ch014
Copyright (c) 2021 Alvaro Marcos Antonio de Araujo Pistono, Arnaldo Manuel Pinto Santos, Ricardo José Vieira Baptista
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish in the JDMI agree to the following terms:
-
Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons BY-NC-ND 4.0. This licensing allows others to share the work with no changes and acknowledgement of the work's authorship and initial publication in this journal, but not for commercial use.
-
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
-
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after publication, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
Copyrights to illustrations published in the journal remain with their current copyright holders.
It is the author's responsibility to obtain permission to quote from copyright sources.
Any fees required to obtain illustrations or to secure copyright permissions are the responsibility of authors.
Additional Information
All correspondence concerning contributions, books and other review material should be sent to: deca-jdmi@ua.pt
