skip to main content


Title: Scaffolds and Nudges: A Case Study in Learning Engineering Design Improvements
We present a brief case study of a multi-year learning engineering effort to iteratively redesign the problem-solving experience of students using the “Solving Quadratic Equations” workspace in Carnegie Learning’s MATHia intelligent tutoring system. We consider two design changes, one involving additional scaffolds for the problem-solving task and the next involving a “nudge” for learners to more rapidly and readily engage with these scaffolds and discuss resulting changes in the relative proportion of students who fail to master skills associated with this workspace over the course of two school years.  more » « less
Award ID(s):
1934745
NSF-PAR ID:
10291624
Author(s) / Creator(s):
Date Published:
Journal Name:
Artificial Intelligence in Education. AIED 2021. Lecture Notes in Computer Science
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Entrepreneurship Support Programs (ESP) in engineering provide education, mentoring, and advising for emerging entrepreneurs and their ventures. The impact of ESPs on engineering students’ professional formation and the acquisition of different attributes—such as creativity, risk-taking, empathy, and curiosity—is largely unknown. Though the social sciences have a strong and robust history of studying many of the attributes, such as creativity and problem-solving, typically associated with entrepreneurship, there has been little connection between this foundational research and the work of ESPs. In fact, two separate systematic reviews have shown that most published work in STEM entrepreneurship education is not theoretically grounded and does not follow standards of quality research approaches in the social sciences. In an effort to bridge the gap between social scientists and engineering entrepreneurship practitioners, the authors are conducting a two-phase study. Phase 1 of the study involves conducting a Delphi study to identify the top entrepreneurial attributes of professionals and researchers who lead ESPs. Phase 2 of the study includes conducting workshops with social scientists who study the attributes and ESP leaders. The goal of the workshops is to identify assessment frameworks grounded in social science theory and literature that will guide the measurement of the attributes. This session will focus on the results of the Delphi phase. Delphi study is a common research technique used to achieve consensus among experts (Hasson, Keeney, and McKenna, 2000). Seventy-three participants who lead or have led an ESP, have conducted research in entrepreneurship education, or act as administrators for relevant entrepreneurship programs were invited to participate in the Delphi study. Of the 73 invited, 14 completed at least two rounds of the Delphi study. All participants were experts in the field of engineering entrepreneurship education. The Delphi Study comprised three rounds- brainstorming, narrowing, and ranking. Each phase of the Delphi asked participants to think about three different sets of attributes: 1) entrepreneurial attributes that they thought were important in the development of an entrepreneur, 2) attributes in becoming a successful professional, and 3) attributes in working in an inclusive workspace. In the brainstorming phase, participants were sent an online questionnaire and were asked to brainstorm as many attributes as they could think of. The results of the brainstorming questionnaire were consolidated and used to develop the narrowing questionnaire, where participants were asked to narrow all attributes to the top 10 key attributes The results from the narrowing questionnaire were then used to develop a ranking questionnaire, where participants were asked to rank the items on a scale of importance with 1 being the most important to 10 being the least important for each set of attributes. The results of the phase 3 questionnaire were analyzed to identify the attributes that were ranked the highest among a majority of the participants. This paper discusses the findings of the Delphi Study and its implications in assessing the impact of ESP on entrepreneur formation. 
    more » « less
  2. The purpose of this study was to investigate fourth-grade students’ sensemaking of a word problem. Sensemaking occurs when students connect their understanding of situations with existing knowledge. We investigated students’ sensemaking through inductive task analysis of their strategies and solutions to a problem that involved determining the difference between two quantities and number of groups within the task. This analysis provided useful themes about students’ strategy use across the sensemaking domains. Students exhibited three levels of sensemaking and many different strategies for solving the problem. Some strategies were more helpful to students in achieving a correct result to the problem. Findings suggest that sensemaking about problems involving differences and number of groups is difficult for many fourth-grade students. Among students who did make sense of the problem, those who used efficient strategies with more familiar operations tended to do better than those who used less efficient strategies or algorithms. 
    more » « less
  3. Culbertson, J. ; Perfors, A. ; Rabagliati, H. ; Ramenzoni, V. (Ed.)
    Integrating visual representations in an interactive learning activity effectively scaffolds performance and learning. However, it is unclear whether and how sustaining or interleaving visual scaffolding helps learners solve problems efficiently and learn from problem solving. We conducted a classroom study with 63 middle-school students in which we tested whether sustaining or interleaving a particular form of visual scaffolding, called anticipatory diagrammatic self-explanation in an Intelligent Tutoring System, helps students’ learning and performance in the domain of early algebra. Sustaining visual scaffolding during problem solving helped students solve problems efficiently with no negative effects on learning. However, in-depth log data analyses suggest that interleaving visual scaffolding allowed students to practice important skills that may help them in later phases of algebra learning. This paper extends scientific understanding that sustaining visual scaffold does not over-scaffold student learning in the early phase of skill acquisition in algebra. 
    more » « less
  4. Culbertson, J. ; Perfors, A. ; Rabagliati, H. ; Ramenzoni, V. (Ed.)
    Integrating visual representations in an interactive learning activity effectively scaffolds performance and learning. However, it is unclear whether and how sustaining or interleaving visual scaffolding helps learners solve problems efficiently and learn from problem solving. We conducted a classroom study with 63 middle-school students in which we tested whether sustaining or interleaving a particular form of visual scaffolding, called anticipatory diagrammatic self-explanation in an Intelligent Tutoring System, helps students’ learning and performance in the domain of early algebra. Sustaining visual scaffolding during problem solving helped students solve problems efficiently with no negative effects on learning. However, in-depth log data analyses suggest that interleaving visual scaffolding allowed students to practice important skills that may help them in later phases of algebra learning. This paper extends scientific understanding that sustaining visual scaffold does not over-scaffold student learning in the early phase of skill acquisition in algebra. 
    more » « less
  5. Computer simulation and animation (CSA) is educational technology in which computer programs are employed to simulate and animate real-world physical phenomena and processes. CSA has attracted growing attention and received an increasing number of applications in the international science, technology, engineering, and mathematics education community in recent years. The present study focuses on developing and assessing two CSA learning modules for improving student learning and problem-solving related to impulse and momentum in particle dynamics. Both CSA learning modules integrate mathematical problem-solving procedures into computer simulation and animation. They have interactive computer graphical user interfaces, which enable students to change input variables and visualize how output variables change accordingly. A quasi-experimental, quantitative research study was performed, involving 285 undergraduate engineering students divided into a comparison group that did not use CSA and an intervention group that used CSA. The results of statistical non-parametric analysis on the data collected from pre- and post-tests on the two groups show that, on average, the intervention group achieved more learning gains than the comparison group by 44% and 40% from two CSA learning modules, respectively. The difference in learning gains between the two groups of student participants was statistically significant.

     
    more » « less