Understanding how a person thinks, i.e., measuring a single individual’s cognitive characteristics, is challenging because cognition is not directly observable. Practically speaking, standardized cognitive tests (tests of IQ, memory, attention, etc.), with results interpreted by expert clinicians, represent the state of the art in measuring a person’s cognition. Three areas of AI show particular promise for improving the effectiveness of this kind of cognitive testing: 1) behavioral sensing, to more robustly quantify individual test-taker behaviors, 2) data mining, to identify and extract meaningful patterns from behavioral datasets; and 3) cognitive modeling, to help map ob- served behaviors onto hypothesized cognitive strategies. We bring these three areas of AI research together in a unified conceptual framework and provide a sampling of recent work in each area. Continued research at the nexus of AI and cognitive testing has potentially far-reaching implications for society in virtually every context in which measuring cognition is important, including research across many disciplines of cognitive science as well as applications in clinical, educational, and workforce settings.
more »
« less
Similarity in Engineering Design: A Knowledge-Based Approach
Abstract Similarity assessment is a cognitive activity that pervades engineering design practice, research, and education. There has been a significant effort in understanding similarity in cognitive science, and some recent efforts on quantifying the similarity of design problems in the engineering design community. However, there is a lack of approaches for measuring similarity in engineering design that embody the characteristics identified in cognitive science, and accounts for the nature of design activities, particularly in the embodiment design phase where scientific knowledge plays a significant role. To address this gap, we present an approach for measuring the similarity among design problems. The approach consists of (i) modeling knowledge using probabilistic graphical models, (ii) modeling the functional mapping between design characteristics and the performance measures relevant in a particular context, and (iii) modeling the dissimilarity using KL-divergence in the performance space. We illustrate the approach using an example of a parametric shaft design for fatigue, which is typically a part of mechanical engineering design curricula, and test the validity of the approach using an experiment study involving 167 student subjects. The results indicate that the proposed approach can capture the well-documented characteristics of similarity, including directionality, context dependence, individual-specificity, and its dynamic nature. The approach is general enough that it can be extended further for assessing the similarity of design problems for analogical design, for assessing the similarity of experimental design tasks to real design settings, and for evaluating the similarity between design problems in educational settings.
more »
« less
- Award ID(s):
- 1662230
- PAR ID:
- 10177428
- Date Published:
- Journal Name:
- ASME 2019 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
- Volume:
- 7
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Context Engineering design skills are essential for engineering students to succeed in their careers. Engineering design is a skill that is in high demand in the current job market and should be prioritized in education. Purpose While design has been acknowledged as a cognitive skill in research, there exists limited literature addressing the cognitive foundations of design thinking. Hence, engineering educators must understand the engineering design process, as well as the different ways students approach design problem-solving and the potential reason behind these differences. To understand how people solve design problems, we need to consider how their minds work and the strategies they use. Spatial ability stands out as a cognitive factor that is crucial for designers and holds significance in well-established theories and models of intelligence. However, to date, research exploring the impact of spatial ability on design thinking and its influence on problem-scoping behaviors remains limited. This paper examines how engineering students’ spatial skills influence how they define the scope of open-ended design problems. The central research question that guides this paper is “How do design problem-scoping behaviors differ for engineering students based on their spatial scores?”. Methods The researchers used a mixed methods research approach to answer their research question, collecting qualitative and quantitative data in two phases. One hundred twenty-seven undergraduate engineering students completed four tests that measure spatial reasoning skills in the quantitative phase and 101 students returned to finish the three design tasks in the second phase. This paper will examine the performance of students with low spatial and high spatial skills on one of the completed design tasks. Outcomes From the study, it was clear that spatial skills have an impact on the design-scoping behaviors of the undergraduate engineering students. It was inferred that high spatial skill visualizers emphasized the technical details of the design problem whereas low spatial skill visualizers emphasized the context of the design problem during their problem-scoping behavior. A Mann-Whitney test revealed there was a statistically significant difference in detail- and context-focused segments between the high and low spatial visualizer groups. Conclusion This research study confirms that a relationship exists between spatial and design skills. The study also found that undergraduate engineering students with different levels of spatial skills had different approaches to scoping design problems.more » « less
-
Context Engineering design skills are essential for engineering students to succeed in their careers. Engineering design is a skill that is in high demand in the current job market and should be prioritized in education. Purpose While design has been acknowledged as a cognitive skill in research, there exists limited literature addressing the cognitive foundations of design thinking. Hence, engineering educators must understand the engineering design process, as well as the different ways students approach design problem-solving and the potential reason behind these differences. To understand how people solve design problems, we need to consider how their minds work and the strategies they use. Spatial ability stands out as a cognitive factor that is crucial for designers and holds significance in well-established theories and models of intelligence. However, to date, research exploring the impact of spatial ability on design thinking and its influence on problem-scoping behaviors remains limited. This paper examines how engineering students’ spatial skills influence how they define the scope of open-ended design problems. The central research question that guides this paper is “How do design problem-scoping behaviors differ for engineering students based on their spatial scores?”. Methods The researchers used a mixed methods research approach to answer their research question, collecting qualitative and quantitative data in two phases. One hundred twenty-seven undergraduate engineering students completed four tests that measure spatial reasoning skills in the quantitative phase and 101 students returned to finish the three design tasks in the second phase. This paper will examine the performance of students with low spatial and high spatial skills on one of the completed design tasks. Outcomes From the study, it was clear that spatial skills have an impact on the design-scoping behaviors of the undergraduate engineering students. It was inferred that high spatial skill visualizers emphasized the technical details of the design problem whereas low spatial skill visualizers emphasized the context of the design problem during their problem-scoping behavior. A Mann-Whitney test revealed there was a statistically significant difference in detail- and context-focused segments between the high and low spatial visualizer groups. Conclusion This research study confirms that a relationship exists between spatial and design skills. The study also found that undergraduate engineering students with different levels of spatial skills had different approaches to scoping design problems.more » « less
-
Previous studies have convincingly shown that traditional, content-centered, and didactic teaching methods are not effective for developing a deep understanding and knowledge transfer. Nor does it adequately address the development of critical problem-solving skills. Active and collaborative instruction, coupled with effective means to encourage student engagement, invariably leads to better student learning outcomes irrespective of academic discipline. Despite these findings, the existing construction engineering programs, for the most part, consist of a series of fragmented courses that mainly focus on procedural skills rather than on the fundamental and conceptual knowledge that helps students become innovative problem-solvers. In addition, these courses are heavily dependent on traditional lecture-based teaching methods focused on well-structured and closed-ended problems that prepare students to plug variables into equations to get the answer. Existing programs rarely offer a systematic approach to allow students to develop a deep understanding of the engineering core concepts and discover systematic solutions for fundamental problems. Without properly understanding these core concepts, contextualized in domain-specific settings, students are not able to develop a holistic view that will help them to recognize the big picture and think outside the box to come up with creative solutions for arising problems. The long history of empirical learning in the field of construction engineering shows the significant potential of cognitive development through direct experience and reflection on what works in particular situations. Of course, the complex nature of the construction industry in the twenty-first century cannot afford an education through trial and error in the real environment. However, recent advances in computer science can help educators develop virtual environments and gamification platforms that allow students to explore various scenarios and learn from their experiences. This study aims to address this need by assessing the effectiveness of guided active exploration in a digital game environment on students’ ability to discover systematic solutions for fundamental problems in construction engineering. To address this objective, through a research project funded by the NSF Division of Engineering Education and Centers (EEC), we designed and developed a scenario-based interactive digital game, called Zebel, to guide students solve fundamental problems in construction scheduling. The proposed gamified pedagogical approach was designed based on the Constructivism learning theory and a framework that consists of six essential elements: (1) modeling; (2) reflection; (3) strategy formation; (4) scaffolded exploration; (5) debriefing; and (6) articulation. We also designed a series of pre- and post-assessment instruments for empirical data collection to assess the effectiveness of the proposed approach. The proposed gamified method was implemented in a graduate-level construction planning and scheduling course. The outcomes indicated that students with no prior knowledge of construction scheduling methods were able to discover systematic solutions for fundamental scheduling problems through their experience with the proposed gamified learning method.more » « less
-
Usable STEM knowledge for tomorrow's STEM problems More universities and education programs need more STEM knowledge in formal and informal settings to guide learners in applying STEM learning to the creation of solutions. To address this challenge, Nancy Butler Songer, the dean of the College of Education at the University of Utah designed a learning approach, Solutioning, that guides youth to deepen science content through science and engineering practices. Creating a six-week curricular program, the learning approach provided opportunities for students to use engineering design to create and provide feedback on a trap design that would attract a local invasive insect that was harmful to their community. Research was conducted on studies to provide empirical evidence on student STEM knowledge and learning and their ability to define science and engineering. Research results indicate that even elementary-age students demonstrate significant improvement in their understanding of STEM arguments as evaluated with a pre-post assessment before and after implementing a six-week solutioning curricular program.more » « less
An official website of the United States government

