skip to main content


Title: RAISE: Robotics & AI to improve STEM and social skills for elementary school students
The authors present the design and implementation of an exploratory virtual learning environment that assists children with autism (ASD) in learning science, technology, engineering, and mathematics (STEM) skills along with improving social-emotional and communication skills. The primary contribution of this exploratory research is how educational research informs technological advances in triggering a virtual AI companion (AIC) for children in need of social-emotional and communication skills development. The AIC adapts to students’ varying levels of needed support. This project began by using puppetry control (human-in-the-loop) of the AIC, assisting students with ASD in learning basic coding, practicing their social skills with the AIC, and attaining emotional recognition and regulation skills for effective communication and learning. The student is given the challenge to program a robot, Dash™, to move in a square. Based on observed behaviors, the puppeteer controls the virtual agent’s actions to support the student in coding the robot. The virtual agent’s actions that inform the development of the AIC include speech, facial expressions, gestures, respiration, and heart color changes coded to indicate emotional state. The paper provides exploratory findings of the first 2 years of this 5-year scaling-up research study. The outcomes discussed align with a common approach of research design used for students with disabilities, called single case study research. This type of design does not involve random control trial research; instead, the student acts as her or his own control subject. Students with ASD have substantial individual differences in their social skill deficits, behaviors, communications, and learning needs, which vary greatly from the norm and from other individuals identified with this disability. Therefore, findings are reported as changes within subjects instead of across subjects. While these exploratory observations serve as a basis for longer term research on a larger population, this paper focuses less on student learning and more on evolving technology in AIC and supporting students with ASD in STEM environments.  more » « less
Award ID(s):
1725554 2114808
NSF-PAR ID:
10388874
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Frontiers in Virtual Reality
Volume:
3
ISSN:
2673-4192
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In 2017, the report Undergraduate Research Experiences for STEM Students from the National Academy of Science and Engineering and Medicine (NASEM) invited research programs to develop experiences that extend from disciplinary knowledge and skills education. This call to action asks to include social responsibility learning goals in ethical development, cultural issues in research, and the promotion of inclusive learning environments. Moreover, the Accreditation Board for Engineering and Technology (ABET), the National Academy of Engineering (NAE), and the National Science Foundation (NSF) all agree that social responsibility is a significant component of an engineer’s professional formation and must be a guiding force in their education. Social Responsibility involves the ethical obligation engineers have to society and the environment, including responsible conduct research (RCR), ethical decision-making, human safety, sustainability, pro bono work, social justice, and diversity. For this work, we explored the views of Social Responsibility in engineering students that could provide insight into developing formal and informal educational activities for future summer programs. In this exploratory multi-methods study, we investigated the following research question: What views of social responsibility are important for engineering students conducting scientific in an NSF Research Experiences for Undergraduates (REU)? The REU Site selected for this study was a college of engineering located at a major, public, comprehensive, land-grant research university. The Views of Social Responsibility of Scientists and Engineers (VSRoSE) was used to guide our research design. This validated instrument considers the following major social responsibility elements: 1) Consideration of societal consequences, 2) Protection of human welfare and safety, 3) Promotion of environmental sustainability, 4) Efforts to minimize risks, 5) Communication with the public, and 6) Service and Community engagement. Data collection was conducted at the end of their 10-week-long experience in Summer 2022 using Qualtrics. REU students were invited to complete an IRB-approved questionnaire, including collecting demographic data, the VSRoSE-validated survey, and open-ended questions. Open-ended questions were used to explore what experiences have influenced positive student views of social responsibility and provide rich information beyond the six elements of the VSRoSE instrument. The quantitative data from the VSRoSE is analyzed using SPSS. The qualitative data is analyzed by the research team using an inductive coding approach. In this coding process, the researchers derive codes from the data allowing the narrative or theory to emerge from the raw data itself, which is great for exploratory research. The results from this exploratory study will help to strategically initiate a formal and informal research education curriculum at the selected university. In addition, the results may serve as a way for REU administrators and faculty to create metrics of impact on their research activities regarding social responsibility. Finally, this work intends to provoke the ethics and research community to have a deeper conversation about the needs and strategies to educate this unique population of students. 
    more » « less
  2. Miller, Eva (Ed.)
    Professor-student interactions influence student learning experiences and performance. The COVID pandemic transformed STEM learning environments across U.S. institutions; however, its impact on STEM professor-student interactions and STEM student learning experiences are yet to be understood. The purpose of this nationwide inductive research study is to examine the impact of COVID-19 on professor-student interactions, undergraduate STEM student learning, and STEM student performance. To achieve this, a qualitative method is adopted and purposive sampling is utilized to enroll 63 STEM students from six U.S institutions. Data is collected through one-hour ZOOM interviews, giving students the opportunity to narrate their STEM learning experiences and performance during the COVID-19 pandemic. The data is analyzed using the NVIVO qualitative analysis software for coding, categorizing, memo-ing, and constant comparative analysis. Results reveal emergent codes on the STEM professor-student interactions to include professor leniency, caring attitude, availability, communication, instruction style, teaching resources, technology literacy, camera on/off requirements, live/recorded sessions, time zone, and student workload. Limited positive impacts on student learning include improved familiarity with alternate STEM learning resources and development of virtual learning soft skills. Negative learning experiences are extensive and coded as: poor comprehension, keeping up, overdrive, isolation, lowered motivation, schedule conflicts, and anxiety. Consequently, students made adaptation decisions coded as: alternate learning sources, refined scheduling, community support, preferring teaching assistants, working out, reporting professors, procrastination, and tuning out. While proactive students and students with prior virtual learning experiences improved or maintained their grades, many students opted for the pass/fail grade or complete withdrawal due to poor STEM learning and performance. Findings indicate that while STEM professors were adjusting to modified teaching environments, many STEM students were developing a sense of independence, self-study, and peer reliance to improve their own STEM understanding and performance with minimal reliance on STEM professors. Lessons learned and best practices for professor-student interactions and student learning are recommended for potential replication in STEM communities for improved adaptability and resiliency during future pandemics. Future research will focus on measuring the effect of best practices on professor-student interactions, student learning experiences, and performance. 
    more » « less
  3. Children diagnosed with autism spectrum disorder (ASD) typically work towards acquiring skills to participate in a regular classroom setting such as attending and appropriately responding to an instructor’s requests. Social robots have the potential to support children with ASD in learning group-interaction skills. However, the majority of studies that target children with ASD’s interactions with social robots have been limited to one-on-one interactions. Group interaction sessions present unique challenges such as the unpredictable behaviors of the other children participating in the group intervention session and shared attention from the instructor. We present the design of a robot-mediated group interaction intervention for children with ASD to enable them to practice the skills required to participate in a classroom. We also present a study investigating differences in children's learning behaviors during robot-led and human-led group interventions over multiple intervention sessions. Results of this study suggests that children with ASD's learning behaviors are similar during human and robot instruction. Furthermore, preliminary results of this study suggest that a novelty effect was not observed when children interacted with the robot over multiple sessions. 
    more » « less
  4. null (Ed.)
    Physical activity (PA) is a health-protective factor with multiple benefits for school-age children, yet only 22% of children and adolescents living in the United States (United States) accrue the recommended amount of moderate to vigorous PA. Given the prevalence of insufficient PA among children, promoting and providing PA opportunities during the school day, especially when integrated into the curriculum and linked to the learning standards, is essential for children. The purpose of this paper is to describe the procedure for the development of a school-based PA program using an integrated approach through the modified intervention mapping protocol (IMP). A total of 22 physical education teachers and 167 children from five different elementary schools were involved in the process. The procedure includes the Self-Determination Theory (SDT) that provides a theoretical framework that plays a vital role in motivating students to have a physically active lifestyle. This study applied SDT and IMP to develop and pilot a PA intervention called Project SMART using an integrative community participatory approach. As a pilot PA intervention, Project SMART is an online educational game where the students navigate a virtual journey across the United States A class’s aggregate PA propels the students on their journey, where standards-based modules are unlocked to achieve STEM (science, technology, engineering, and math) and social-emotional learning outcomes while gaining an understanding of the importance of health behaviors and opportunities to habitually engage in healthy decision-making with the support of their peers. Although initially labor intensive for the researchers, the process of tailoring the intervention to the children’s contextual and cultural needs has implications for all theoretically grounded and evidence-based PA interventions. 
    more » « less
  5. This project addresses the disconnect between science, design, and technology and how high school students can benefit from innovative learning experiences in plant science that integrate these disciplines while gaining interest in and skills for future STEM careers. We created a research experience where students work in collaborative teams of self-identified science, technophile, and art students to create 3D models of plants under research at the Donald Danforth Plant Science Center. Through augmented and virtual reality immersive experiences, the students understand the benefits of integrating science, technology, and design. The students also practice their communication skills by disseminating their projects. We use a mixed-methods approach to assess changes in students’ understanding of the role of design and technology in STEM, gain of knowledge and appreciation of plant science, and development of interests in STEM subjects and careers. Preliminary results indicate that students are more aware of the role of design in science and vice versa and are more interested in STEAM subjects. Future results will provide a better understanding of the impact on plant awareness and interest in STEAM careers. This project will contribute to the body of knowledge on theory, best practices, and practical technological applications in STEAM education. 
    more » « less