Scientific Journal

Herald of Advanced Information Technology

INTEGRATION OF THE PROCESS OF COMPUTER GAME DEVELOPMENT WITH AUGMENTED REALITY IN STREAM-EDUCATION COMPONENTS
Abstract:

 

This article describes the links between STREAM-education components (Science, Technology, Reading/Writing, Engineering, Arts, Mathematics) and the stages of computer game development (StoryTelling/Scripts, GameDesign, 2D/3D-Computer graphics, Programming, Testing, and Game Level) on the example of using sensors of human movement control. In order to effectively integrate the computer game development process with the augmented reality into the component of STREAM-education, the method for creating a real-complemented virtual training exercises using an example of training with a ball on the basis of the MS Kinect motion sensor is proposed. As a result of the analysis of the virtual environment characteristics created by the sensor of the MS Kinect controller and taking into account the limits of the Scratch program, it is proposed to formalize the characteristics of the virtual environment. The results of the analysis of games offered by LumoPlay and MotionMagix software manufacturers in logic, sports, entertaining classes in various game genres and relaxation with special effects are given. Examples of experiments are shown during the organization of two Meet and Code 2018 master-classes for schoolchildren of virtual programming, complemented by the reality of football training, which has confirmed the interest of students in participating in many STREAM-related learning processes. The results of the work also identified the directions of further research and development; in the research process the estimation of the visualization error of virtual objects determined the need for the development of a special algorithm for automatic correction of the coordinates of the location of virtual sprite objects that are part of a single group of objects player's body; Many examples of commercial game systems are based on new templates that allow you to quickly change the graphic part of the game, so it is planned to create similar scratch templates for developing games.

 

Authors:
Keywords
DOI
//10.15276/hait.01.2018.5
References
  1. Kelley, T.R., & Knowles, J.G. (2016). “A conceptual framework for integrated STEM education”, International Journal of STEM Education, 3: 11. DOI: https://doi.org/10.1186/s40594-016-0046-z.
  2. Michelle, H. (2013).“Land Full STEAM ahead: The benefits of integrating the arts into STEM”, Procedia Computer Science,No. 3, pp. 547-552.
  3. Lefever-Davis, S., &Pearman, C. J. (2015), Reading, Writing and Relevancy: Integrating 3R's into STEM, Open Communication Journal,No. 9(1), pp.61-64.
  4. Krutiy, K. & Hrytsyshyna, T. (2016).“STREAM-education preschoolers: educate the culture of engineering thinking”, Preschool education,No. 1, pp. 3–7 (in Ukrainian).
  5. Hamari, J., Koivisto, J., & Sarsa, H. (2014). “Does Gamification Work? – A Literature Review of Empirical Studies on gamification”, In proceedings of the 47-th Hawaii International Conference on System Sciences, Hawaii, USA, January 6-9, 2014, pp. 3025-3034.
  6. Blazhko, O.,Luhova, T., Melnik S.,& Ruvinska, V. (2017). “Communication Model of Open Government Data Gamification Based on Ukrainian Websites”, 4-th Experiment@ International Conference (exp.at'17) June 6-th – 8-th, 2017, University of Algarve, Faro, Portugal,pp. 181-186.
  7. Bouras, C., Igglesis, V., Kapoulas, V., Misedakis, I., Dziabenko, O., Koubek, A., Pivec, M., & Sfiri A. (2005). “Game-Based Learning Using Web Technologies”, International Journal of Intelligent Games and Simulations, No. 3(2), pp. 70-87.
  8. “Deeper learning competencies” [Electronic resource]. – Аccess mode: https://www.hewlett.org/wpcontent/uploads/2016/08/Deeper_Learning_Defined__April_2013.pdf. – Active link –03.12.2018
  9. Blazhko, O., Gdowska, K., Gawel, B., Dziabenko, O., & Luhova, Т. (2017). “Deeper learning approaches integrated in serious games”, Project, Program, Portfolio Management. P3M. In The Proceedings of the International Research Conference, Vol. 2, pp. 18-21, December. – Available at: http://dspace.opu.ua/jspui/handle/123456789/6866.
  10. Gee James, P. (2018). “What Video Games Have to Teach Us about Learning and Literacy”. [Electronic resource]. – Аccess mode: http://newlearningonline.com/literacies/chapter-2/gee-on-what-video-games-have-to-teach-us-about-learning-and-literacy. – Active link –03.12.2018.
  11. Gdowska, K.,Gaweł, B., Dziabenko, O., & Blazhko, O. (2018). “Gamification in teaching humanities – „GameHub” project”, V e-Technologie w działaniach edukacyjnych w projekcie GameHub V Konferencja e-Technologie w Kształceniu Inżynierów Akademia Górniczo-Hutnicza im. Stanisława Staszica w Krakowie, Kraków, Poland, 19-20 kwietnia 2018, pp.27-32.
  12. Adams, E. (2014). “Fundamentals of Game Design”, New Riders, 560 p.
  13. Sandhya Devi, Gogula, & Chanakya, Puranam.(2015). “Augmented Reality in Enhancing Qualitative Education, International” Journal of Computer Applications, Vol. 132, No.14, pp. 41-45.
  14. Dormans,J. (2012). “Engineering emergence: applied theory for game design”. PhD thesis 13. 288 p. – Available at: http://hdl.handle.net/11245/1.358623.
  15. Hunicke, R., LeBlanc, M.,&Zubec, R. (2004).“MDA: A formal approach to game design and gameresearch”.In: Proceedings of the AAAI Workshop on Challenges in Game AI. Vol. 4.
  16. Winn, В. (2009).“The Design, Play, and Experience Framework. Handbook of Research on Effective Electronic Gaming in Education”. Richard Ferdig (editor). Vol. 3, Chapter 58.
  17. Luhova, T.A., & Blazhko O. A.(2018).Razrabotka obuchayushchikh videoigr na osnove aktivatsii neyavnykh znaniy [Development ofeducational video games based on the activation of implicit knowledge]Management of Development of Complex Systems,No. 35, pp. 105-112 (in Ukrainian)
  18. Blazhko, O.A., Antonyuk, V.V.,& Troyanovska, Y. L.,(2018). Instrumental'nye osobennosti avtomaticheskogo programmirovaniya komp'yuternykh igr [Instrumental Features of Automata-Based Programming of Computer Games] Management of Development of Complex Systems, No. 35, pp. 83-92 (in Ukrainian).
  19. Damien Djaouti, Julian Alvarez, Jean-Pierre Jessel, Gilles Methel & Pierre Molinier (2008).“A Gameplay Definition through Videogame Classification”, International Journal of Computer Games Technology, 2008. http://dx.doi.org/10.1155/2008/470350.
  20. David Weintrop & Uri Wilensky. (2017).“Comparing Block-Based and Text-Based Programming in High School Computer Science Classrooms”. ACM Trans. Comput. Educ. 18, 1, Article 3 (October 2017), 25 p.
  21. Louise P.Flannery, Brian Silverman, Elizabeth R.Kazakoff, Marina Umaschi Bers, PaulaBontá, & Mitchel Resnick (2013),“Designing ScratchJr: Support for early childhood learning through computer programming”. In Proceedings of the 12-th International Conference on Interaction Design and Children. ACM, pp. 1-10.
  22. Neil Fraser. (2015).“Ten things we’ve learned from Blockly”. In Proceedings of the 2015 IEEE Blocks and BeyondWorkshop (Blocks and Beyond) pp. 49-50.
  23. David Wolber, Hal Abelson, Ellen Spertus& Liz Looney. (2014).“App Inventor 2: Create Your Own Android Apps”. 2-nd ed. Beijing: O’Reilly Media.
  24. Jared, St. J. (2012).“Kinect Hacks Tips & Tools for Motion and Pattern Detection”Publisher: O'Reilly Media, 280 p.
  25. Blazhko, O.A.& Ryashchenko, O.I. (2018). Osobennosti STREAM-obrazovaniya na osnove razrabotki komp'yuternykh igr s ispol'zovaniem datchika dvizheniya cheloveka MS Kinect [Features of STREAM-Education Based on Computer Game Development by using Human Motion Sensor MS Kinect]Procs. of ІІІ International scientific-practical Conference P3M-2018 Project, Program, Portfolio Management, 7-8 hrudnya, 2018, Odesa, Ukrayina, Odesa : Balan V. O., No.2/1,pp. 11-14 (in Ukrainian).
  26. Ryashchenko, O.I& Blazhko, O.A. (2018).Sposob realizatsii deystvitel'no dopolnennoy virtual'nosti trenirovki s myachom s ispol'zovaniem datchika dvizheniya kontrollera MS Kinect [Method of implementation of really augmented virtuality of training with the ball by using sensor motion controller MSKinect]Procs. of the I International Scientific and Practical Conference “Imperatives of Civil Society Development in Ensuring National Competitiveness”, Vol. 1, 13-14 hrudnya 2018 roku, Batumi, Hruziya, Batumi : Publishing House “Kalmosani”, pp. 208-210(in Ukrainian).
  27. “Lumoplay” [Electronic resource] : – Access mode: https://www.lumoplay.com. –Active link – 03.12.2018.
  28. “MotionMagix” [Electronic resource] : –Access mode : http://www.motionmagix.com/ – Active link – 03.12.2018.
  29. “MetaVerse” [Electronic resource] : –Access mode : https://gometa.io/. –Active link – 03.12.2018.
  30. “Some examples of the more than 1300 soccer exercises in our database” [Electronic resource]: – Access mode : https://www.footballtraining4all.com/en-gb/exercises.aspx –Title from the screen. – Active link –03.12.2018.
  31. Jere Miles. (2016).“Unity 3D and PlayMaker Essentials: Game Development from Concept”to Publishing (Focal Press Game Design Workshops) Paperback, Publisher: A K Peters/CRC Press, 506 p.
  32. “Meet and Code 2018 in Odessa at ONPU” [Electronic resource] : –Access mode : https://youtu.be/IjdOTClEM1M –Title from the screen. – Active link – 03.12.2018.
  33. “Meet and Code 2018 in Izmail at School No. 10” [Electronic resource] : –Access mode : https://youtu.be/1ha19XVm7KQ –Title from the screen.– Active link – 03.12.2018.

 

Published:
Last download:
30 June 2020

[ © KarelWintersky ] [ All articles ] [ All authors ]
[ © Odessa National Polytechnic University, 2018.]