Creating effective middle school STEM curricula requires a combination of individual and collaborative learning. Prior studies showed that finding a proper balance and providing uninterrupted knowledge transmission between different learning modes can be challenging in such mixed pedagogical approaches. In this paper, we present a multi-device interactive educational platform named SimSnap to teach biology curriculum to middle school children. SimSnap facilitates interactions among touchscreen Chromebooks to perform in-class individual and group activities. We present a usability analysis study with eight middle school children where they learn about the influence of temperature on tomato plant growth. Our study demonstrated that SimSnap facilitates group discussions to complete collaborative tasks. It also creates seamless knowledge propagation between prior to current tasks to learn about more complex concepts from previous simpler activities. Middle school children gave overall high usability ratings and positive feedback on SimSnap. This study also helped to outline some design recommendations for future improvements of SimSnap.
more »
« less
Touchibo: Multimodal Texture-Changing Robotic Platform for Shared Human Experiences
Touchibo is a modular robotic platform for enriching interpersonal communication in human-robot group activities, suitable for children with mixed visual abilities. Touchibo incorporates several modalities, including dynamic textures, scent, audio, and light. Two prototypes are demonstrated for supporting storytelling activities and mediating group conversations between children with and without visual impairment. Our goal is to provide an inclusive platform for children to interact with each other, perceive their emotions, and become more aware of how they impact others.
more »
« less
- Award ID(s):
- 1830471
- NSF-PAR ID:
- 10462964
- Date Published:
- Journal Name:
- UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Children with dyslexia frequently also struggle with math. However, studies of reading disability (RD) rarely assess math skill, and the neurocognitive mechanisms underlying co‐occurring reading and math disability (RD+MD) are not clear. The current study aimed to identify behavioral and neurocognitive factors associated with co‐occurring MD among 86 children with RD. Within this sample, 43% had co‐occurring RD+MD and 22% demonstrated a possible vulnerability in math, while 35% had no math difficulties (RD‐Only). We investigated whether RD‐Only and RD+MD students differed behaviorally in their phonological awareness, reading skills, or executive functions, as well as in the brain mechanisms underlying word reading and visuospatial working memory using functional magnetic resonance imaging (fMRI). The RD+MD group did not differ from RD‐Only on behavioral or brain measures of phonological awareness related to speech or print. However, the RD+MD group demonstrated significantly worse working memory and processing speed performance than the RD‐Only group. The RD+MD group also exhibited reduced brain activations for visuospatial working memory relative to RD‐Only. Exploratory brain‐behavior correlations along a broad spectrum of math ability revealed that stronger math skills were associated with greater activation in bilateral visual cortex. These converging neuro‐behavioral findings suggest that poor executive functions in general, including differences in visuospatial working memory, are specifically associated with co‐occurring MD in the context of RD.
Research Highlights Children with reading disabilities (RD) frequently have a co‐occurring math disability (MD), but the mechanisms behind this high comorbidity are not well understood.
We examined differences in phonological awareness, reading skills, and executive function between children with RD only versus co‐occurring RD+MD using behavioral and fMRI measures.
Children with RD only versus RD+MD did not differ in their phonological processing, either behaviorally or in the brain.
RD+MD was associated with additional behavioral difficulties in working memory, and reduced visual cortex activation during a visuospatial working memory task.
-
Our NSF-funded project, CoBuild19, sought to address the large-scale shift to at-home learning based on nationwide school closures that occurred during COVID-19 through creating making/STEM activities for families with children in grades K-6. Representing multiple organizations, our CoBuild19 project team developed approximately 60 STEM activities that make use of items readily available in most households. From March through June 2020, we produced and shared videos and activity guides, averaging 3+ new activities per week. Initially, the activities consisted of whatever team members could pull together, but we soon created weekly themes with associated activities, including Design and Prototype Week, Textiles Week, Social and Emotional Learning Week, and one week which highlighted kids sharing cooking and baking recipes for other kids. All activities were delivered fully online. To do so, our team started a Facebook group on March 13, 2020. Membership grew to 3490 followers by April 1st, to 4245 by May 1st, and leveled off at approximately 5100 members since June 2020. To date, 22 of our videos have over 1000 views, with the highest garnering 23K views. However, we had very little participation in the form of submitted videos, images, or text from families sharing what they were creating, limiting our possible analyses. While we had some initial participation by members, as the FB group grew, substantive evidence of participation faded. To better understand this drop, we polled FB group members about their use of the activities. Responses (n = 101) were dominated by the option, "We are glad to know the ideas are available, but we are not using much" (49%), followed by, "We occasionally do activities" (35%). At this point, we had no data about home participation, so we decided to experiment with different approaches. Our next efforts focused on conducting virtual maker/STEM camps. Leveraging the content produced in the first months of CoBuild19, we hosted two rounds of Camp CoBuild by the end of July, serving close to 100 campers. The camps generated richer data in the form of recorded Zoom camp sessions where campers made synchronously with educators and youth-created Flipgrid videos where campers shared their process and products for each activity. We also collected post-camp surveys and some caregiver interviews. Preliminary analyses have focused on the range of participant engagement and which malleable factors may be associated with deeper engagement. Initial feedback from caregivers indicated that their children gained confidence to experiment with simple materials through engaging in these activities. This project sought to fill what we perceived as a developing need in the community at a large scale (e.g., across the US). Although we have not achieved the level of success we expected, the project achieved quick growth that took us in a different direction than we originally intended. Overall, we created content that educators and families can use to engage kids with minimal materials. Additionally, we have a few models of extended engagement (e.g., Camp CoBuild) that we can develop further into future offerings.more » « less
-
How do life experiences impact cortical function? In people who are born blind, the “visual” cortices are recruited for nonvisual tasks such as Braille reading and sound localization (e.g., Collignon et al., 2011; Sadato et al., 1996). The mechanisms of this recruitment are not known. Do visual cortices have a latent capacity to respond to nonvisual information that is equal throughout the lifespan? Alternatively, is there a sensitive period of heightened plasticity that makes visual cortex repurposing possible during childhood? To gain insight into these questions, we leveraged naturalistic auditory stimuli to quantify and compare cross-modal responses congenitally blind (CB, n=22), adult-onset blind (vision loss >18 years-of-age, AB, n=14) and sighted (n=22) individuals. Participants listened to auditory excerpts from movies; a spoken narrative; and matched meaningless auditory stimuli (i.e., shuffled sentences, backwards speech) during fMRI scanning. These rich naturalistic stimuli made it possible to simultaneous engage a broad range of cognitive domains. We correlated the voxel-wise timecourses of different participants within each group. For all groups, all stimulus conditions induced synchrony in auditory cortex and for all groups only the narrative stimuli synchronized responses in higher-cognitive fronto-parietal and temporal regions. Inter-subject synchrony in visual cortices was high in the CB group for the movie and narrative stimuli but not for meaningless auditory controls. In contrast, visual cortex synchrony was equally low among AB and sighted blindfolded participants. Even many years of blindness in adulthood fail to enable responses to naturalistic auditory information in visual cortices of people who had sight as children. These findings suggest that cross-modal responses in visual cortex of people born blind reflect the plasticity of developing visual cortex during a sensitive period.more » « less
-
Tele-operated collaborative robots are used by many children for academic learning. However, as child-directed play is important for social-emotional learning, it is also important to understand how robots can facilitate play. In this article, we present findings from an analysis of a national, multi-year case study, where we explore how 53 children in grades K–12 (n= 53) used robots for self-directed play activities. The contributions of this article are as follows. First, we present empirical data on novel play scenarios that remote children created using their tele-operated robots. These play scenarios emerged in five categories of play: physical, verbal, visual, extracurricular, and wished-for play. Second, we identify two unique themes that emerged from the data—robot-mediated play as a foundational support of general friendships and as a foundational support of self-expression and identity. Third, our work found that robot-mediated play provided benefits similar to in-person play. Findings from our work will inform novel robot and HRI design for tele-operated and social robots that facilitate self-directed play. Findings will also inform future interdisciplinary studies on robot-mediated play.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
