More Like this

1. Improving Stealth Assessment in Game-Based Learning with LSTM-Based Analytics

   Akram, B. ; Min, W. ; Wiebe, E. ; Mott, B. ; Boyer, K. E. ; Lester, J. ( July 2018 , International Conference on Educational Data Mining)

   A key affordance of game-based learning environments is their potential to unobtrusively assess student learning without interfering with gameplay. In this paper, we introduce a temporal analytics framework for stealth assessment that analyzes students' problem-solving strategies. The strategy-based temporal analytic framework uses long short-term memory network-based evidence models and clusters sequences of students' problem-solving behaviors across consecutive tasks. We investigate this strategy based temporal analytics framework on a dataset of problem solving behaviors collected from student interactions with a game-based learning environment for middle school computational thinking. The results of an evaluation indicate that the strategy-based temporal analytics framework significantly outperforms competitive baseline models with respect to stealth assessment predictive accuracy.
2. SAGE-RA: A Reference Architecture to Advance the Teaching and Learning of Computational Thinking

   Sulaiman, Johan ; Dziena, Alex ; Bender, Jeff ; Kaiser, Gail ( September 2019 , International Conference on Embedding Artificial Intelligence (AI) in Education Policy and Practice for Southeast Asia)

   Rapid technological advances and the increasing number of students in Southeast Asian nations present a difficult challenge: how should schools adequately equip teachers with the right tools to effectively teach Computational Thinking, when the demand for such teachers outstrips their readiness and availability? To address this challenge, we present the SAGE reference architecture: an architecture for a learning environment for elementary, middle-school and high-school students based on the Scratch programming language. We synthesize research in the domains of game-based learning, implicit assessments, intelligent tutoring systems, and learning conditions, and suggest a teacher-assisting instructional platform that provides automated and personalized machine learning recommendations to students as they learn Computational Thinking. We discuss the uses and components of this system that collects, categorizes, structures, and refines data generated from students’ and teachers’ interactions, and also facilitates personalized student learning through: 1) predictions of students’ distinct programming behaviors via employment of clustering and classification models, 2) automation of aspects of formative assessment formulations and just-in- time feedback delivery, and 3) utilization of item-based and user-based collaborative filtering to suggest customized learning paths. The proposed reference architecture consists of several architectural components, with explanations on their necessity and interactions to foster future replications ormore »adaptations in similar educational contexts.« less
3. Teacher Self-efficacy During Professional Development for Game Design and Unity

   https://doi.org/10.1145/3478432.3499039  

   Hodges, Charles B. ; Akcaoglu, Mete ; Allen, Andrew ; Doğan, Selçuk ( March 2022 , Proceedings of the 53rd ACM Technical Symposium on Computer Science Education)

   Teacher self-efficacy (SE) has been observed to be an 'important construct for Computer Science (CS) teachers' professional development because it can predict both teaching behaviors as well as student outcomes" [1]. The purpose of the present study was to investigate teacher CS SE during a two-year federally funded professional development (PD) and curriculum development project for middle school teachers incorporating game-design and the Unity development platform. The research question investigated is: How does teacher self-efficacy for teaching computer science via game design with the Unity game development platform change during a year-long PD program? Investigations of teacher SE for teaching CS have resulted in some surprising results. For example, it has been reported that - There were no differences in self-efficacy based on teachers' overall level of experience, despite previous findings that teacher self-efficacy is related to amount of experience" and "no differences in self-efficacy related to the teachers' own level of experience with CS" [2], thus further study of CS teacher SE is warranted. Participants in this study were six middle school teachers from four middle schools in the southeastern United States. They participated in a year-long PD program learning the Unity game development platform, elements of game design,more »and foundations of learner motivation. Guided reflective journaling was used to track the teachers' SE during the first year of the project. Teachers completed journal prompts at four intervals. Prompts consisted of questions like "How do you currently feel about your ability to facilitate student learning with Unity?" and "Are you confident that you can implement the materials the way the project team has planned for them to be implemented?" Prior to beginning the project participants expressed confidence in being able to facilitate student learning after participating in the planned professional development, but there was some uneasiness about learning and using Unity. From a SE perspective their responses make sense, as all of the participants are experienced teachers and should have confidence in their general ability to teach. However, since Unity is a new programming environment for all of the teachers, they did not have the prior experience necessary to have a high degree of confidence that they could successfully use it with their students.« less
4. Engineering Ethics Through High-Impact Collaborative/Competitive Scenarios (E-ETHICCS): Initial Results and Lessons Learned.

   Streiner, S ; Burkey, D ; Young, M. ; Cimino, R. ; Pascal, J. ; Dahm, K. ( August 2022 , ASEE Annual Conference proceedings)

   Ethics education has been recognized as increasingly important to engineering over the past two decades, although disagreement exists concerning how ethics can and should be taught in the classroom. With active learning strategies becoming a preferred method of instruction, a collaboration of authors from four universities (University of Pittsburgh, University of Connecticut, Rowan University and New Jersey Institute of Technology) are investigating how game-based or playful learning with strongly situated components can influence first-year engineering students’ ethical knowledge, awareness, and decision making. This paper offers an overview and results of the progress to date of this three year, NSF Improving Undergraduate STEM Education (IUSE) grant that aims to (1) characterize the ethical awareness and decision making of first-year engineering students, (2) develop game-based learning interventions focused on ethical decision making, and (3) determine how (and why) game-based approaches affect students’ ethical awareness in engineering and the advantages of such approaches over non game-based approaches. Now in its second year, the authors have conducted a preliminary analysis of first-year students' ethical knowledge and organization via a concept mapping approach and have measured students' ethical reasoning using the Defining Issues Test 2 (DIT2) and Engineering Ethics Reasoning Instrument (EERI). Further, the authorsmore »have developed a suite of ethics-driven games that have been implemented across three of the universities, engaging over 400 first-year engineering students. Evaluation data has also been gathered for further game development and to assess initial student engagement and learning. Year 1 has provided insight into where first-year engineering students “are at” in terms of ethical knowledge and reasoning when they come to college, and how game-based instruction can be effective in the development of these students into moral agents who understand the consequences of their decisions. Further results from this investigation will provide the engineering education community with a set of impactful and research-based playful learning pedagogy and assessment that will help students confront social and ethical dilemmas in their professional lives.« less
5. An initial exploration of the perspectives and experiences of diverse learners’ acceptance of online educational engineering games as learning tools in the classroom

   https://doi.org/10.1109/FIE43999.2019.9028605  

   Cook-Chennault, Kimberly ; Villanueva, Idalis ( October 2019 , An initial exploration of the perspectives and experiences of diverse learners' acceptance of online educational engineering games as learning tools in the classroom)

   This Work-In-Progress falls within the research category of study and, focuses on the experiences and perceptions of first- and second year engineering students when using an online engineering game that was designed to enhance understanding of statics concepts. Technology and online games are increasingly being used in engineering education to help students gain competencies in technical domains in the engineering field. Less is known about the way that these online games are designed and incorporated into the classroom environment and how these factors can ignite inequitable perspectives and experiences among engineering students. Also, little if any work that combines the TAM model and intersectionality of race and gender in engineering education has been done, though several studies have been modified to account for gender or race. This study expands upon the Technology Acceptance Model (TAM) by exploring perspectives of intersectional groups (defined as women of color who are engineering students). A Mixed Method Sequential Exploratory Research Design approach was used that extends the TAM model. Students were asked to play the engineering educational game, complete an open-ended questionnaire and then to participate in a focus group. Early findings suggest that while many students were open to learning to use themore »game and recommended inclusion of online engineering educational games as learning tools in classrooms, only a few indicated that they would use this tool to prepare for exams or technical job interviews. Some of the main themes identified in this study included unintended perpetuation of inequality through bias in favor of students who enjoyed competition-based learning and assessment of knowledge, and bias for students having prior experience in playing online games. Competition-based assessment related to presumed learning of course content enhanced student anxiety and feelings of intimidation and led to some students seeking to “game the game” versus learning the material, in efforts to achieve grade goals. Other students associated use of the game and the classroom weighted grading with intense stress that led them to prematurely stop the use of the engineering tool. Initial findings indicate that both game design and how technology is incorporated into the grading and testing of learning outcomes, influence student perceptions of the technology’s usefulness and ultimately the acceptance of the online game as a "learning tool." Results also point to the need to explore how the crediting and assessment of students’ performance and learning gains in these types of games could yield inequitable experiences in these types of courses.« less