Role-plays of interpersonal interactions are essential to learning across professions, but effective simulations are difficult to create in typical learning management systems. To empower educators and researchers to advance simulation-based pedagogy, we have developed the Digital Clinical Simulation Suite (DCSS, pronounced "decks"), an open-source platform for rehearsing for improvisational interactions. Participants are immersed in vignettes of professional practice through video, images, and text, and they are called upon to improvisationally make difficult decisions through recorded audio and text. Tailored data displays support participant reflection, instructional facilitation, and educational research. DCSS is based on six design principles: 1) Community Adaptation, 2) Masked Technical Complexity, 3) Authenticity of Task, 4) Improvisational Voice, 5) Data Access through "5Rs", and 6) Extensible AI Coaching. These six principles mean that any educator should be able to create a scenario that learners should engage in authentic professional challenges using ordinary computing devices, and learners and educators should have access to data for reflection, facilitation, and development of AI tools for real-time feedback. In this paper, we describe the architecture of DCSS and illustrate its use and efficacy in cases from online courses, colleges of education, and K-12 schools.
more »
« less
A Pilot Study Investigating STEM Learners’ Ability to Decipher AI-generated Video
Artificial Intelligence (AI) techniques such as Generative Neural Networks (GNNs) have resulted in remarkable breakthroughs such as the generation of hyper-realistic images, 3D geometries, and textual data. This work investigates the ability of STEM learners and educators to decipher AI generated video in order to safeguard the public-availability of high-quality online STEM learning content. The COVID-19 pandemic has increased STEM learners’ reliance on online learning content. Consequently, safeguarding the veracity of STEM learning content is critical to ensuring the safety and trust that both STEM educators and learners have in publicly-available STEM learning content. In this study, state of the art AI algorithms are trained on a specific STEM context (e.g., climate change) using publicly-available data. STEM learners are then presented with AI-generated STEM learning content and asked to determine whether the AI-generated output is visually convincing (i.e., “looks real”) and whether the context being presented is plausible. Knowledge gained from this study will help enhance society’s understanding of AI algorithms, their ability to generate convincing video output, and the threat that those generated output have in potentially deceiving STEM learners who may be exposed to them during online learning activities.
more »
« less
- PAR ID:
- 10292836
- Date Published:
- Journal Name:
- 2021 ASEE Virtual Annual Conference
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Sinatra, Anne; Goldberg, Benjamin (Ed.)Over the past decade, the educational landscape has experienced a surge of online learning and instruc-tional platforms (Liu et al., 2020). This remarkable surge can be attributed to a confluence of factors, including the rising demand for higher education opportunities, the shortage of available teaching staff, and the rapid advancements in information technology and artificial intelligence capabilities. Artificial Intelligence (AI) remained a niche area of research with limited practical applications in education for over half a century (Bhutoria, 2022; Chen et al., 2020; Roll & Wylie, 2016) from 1950 to 2010. Howev-er, in recent years, the advent of Big Data and advancements in computing power have propelled AI into the educational mainstream (Alam, 2021; Chen et al., 2020; Hwang et al., 2020). Today, the rise of machine learning, deep learning, automation, together with advances in big data analysis has sparked novel perspectives and explorations around the potential of enhancing personalized learning, a long-term educational vision of technology-enhanced course options to meet student needs (Grant & Basye, 2014). Fostering personalized learning necessitates the development of digital learning environments that dynamically adapt to individual learners' knowledge, prior experiences, and interests, while effectively and efficiently guiding them towards achieving desired learning outcomes (Spector, 2014, 2016). AI-powered technologies have made it possible to analyze data generated by learners and provide instruc-tion that matches their learning performance. Through learning analytics and data mining techniques, large datasets collected are analyzed and processed to uncover learners' unique learning characteristics, often referred to as learner profiling (Tzouveli et al., 2008). Subsequently, leveraging artificial intelli-gence algorithms, the learning content is tailored, and personalized learning paths are designed to align with each learner's identified needs and preferences, thereby facilitating personalized learning experienc-es.more » « less
-
Learners' awareness of their own affective states (emotions) can improve their meta-cognition, which is a critical skill of being aware of and controlling one's cognitive, motivational, and affect, and adjusting their learning strategies and behaviors accordingly. To investigate the effect of peers' affects on learners' meta-cognition, we proposed two types of cues that aggregated peers' affects that were recognized via facial expression recognition:Locative cues (displaying the spikes of peers' emotions along a video timeline) andTemporal cues (showing the positivities of peers' emotions at different segments of a video). We conducted a between-subject experiment with 42 college students through the use of think-aloud protocols, interviews, and surveys. Our results showed that the two types of cues improved participants' meta-cognition differently. For example, interacting with theTemporal cues triggered the participants to compare their own affective responses with their peers and reflect more on why and how they had different emotions with the same video content. While the participants perceived the benefits of using AI-generated peers' cues to improve their awareness of their own learning affects, they also sought more explanations from their peers to understand the AI-generated results. Our findings not only provide novel design implications for promoting learners' meta-cognition with privacy-preserved social cues of peers' learning affects, but also suggest an expanded design framework for Explainable AI (XAI).more » « less
-
Interpolated retrieval enhances the learning of new information—a finding known as the forward testing effect. The context change account suggests that learning benefits are due to a shift in internal context, which can be triggered through the retrieval of either content-relevant or content-irrelevant information. In two experiments, we examined whether interpolated episodic, autobiographical, and semantic retrieval would enhance new learning of a video lecture, compared to interpolated review. Participants watched a STEM topic lecture divided into three ~5 min segments and completed their assigned interpolated activity after the first two segments. Across both a laboratory (Experiment 1, N = 249) and online setting (Experiment 2, N = 246), only episodic retrieval enhanced the learning of new material; autobiographical and semantic retrieval (content-irrelevant) did not improve new learning. Critically, we introduced a measure of context change to determine whether the level of engagement in these interpolated activities predicted recall. Engagement correlated with criterial test performance when controlling for effort (seriousness). Our results support a multi-factor explanation for the forward testing effect, providing evidence for both the context change and strategy change accounts, although we emphasize that support for context change should be interpreted with caution.more » « less
-
Supporting learners’ agency in constructing and using STEM knowledge is critical not only for fostering deeper learning, but also for making STEM education more equitable and inclusive. Informal learning environments like museums and science centers often prioritize agency within hands-on and interactive learning experiences, but few studies have defined what agency looks like within these spaces. The current study uses theoretical understandings of epistemic agency as a lens for understanding families’ experiences in science centers. A team of researchers, exhibit designers, educators, and museum facilitators collaboratively generated a working definition of agency in the context of families’ science center visits, and created a reflection tool to help museum practitioners notice observable aspects of agency in families’ interactions at STEM exhibits.more » « less
An official website of the United States government

