Problem solving is an essential part of engineering. Research shows that students are not exposed to ill-structured problems in the engineering classrooms as much as well-structured problems and do not feel as confident and comfortable solving them. There have been several studies on how engineering students solve and perceive ill-structured problems, however, understanding engineering faculty’s perceptions of teaching and solving such problems is important as well. Since it is the engineering faculty who teach students how to approach engineering problems, it is essential to understand how they perceive solving and teaching of these problems. The following research question has guided this research: What beliefs do engineering faculty have about teaching and solving ill-structured problems? Ten tenure-track or tenured faculty in civil engineering from various universities across the U.S. were interviewed after solving an ill-structured engineering problem. Their responses were transcribed and coded. The findings suggest that faculty generally preferred to teach both well-structured and ill-structured problems in their courses. They also acknowledge the advantages of ill-structured problems, in that they promote critical thinking, require creativity, and are more challenging. However, the results showed that some are less likely to use ill-structured problems in their teaching compared to well-structured problems. We also found that faculty became more comfortable teaching ill-structured problems as they gain more experience in teaching these types of problems. Faculty’s responses showed that while they solve ill-structured problems as part of their research on a regular basis, some faculty do not integrate these problems in the classes that they teach. These results indicate that although faculty recognize the importance of using ill-structured problems while teaching, the lack of experience with teaching these problems, other faculty responsibilities, and the complex nature of these problems make it challenging for engineering faculty to incorporate these problems into the engineering classroom. Based on these findings, in order to improve faculty’s comfort and willingness to use ill-structured problems in their teaching, recommendations for faculty are provided in the paper.
more »
« less
Effects of Guidance on Learning about Ill-defined Problems
We present a study that examines the effects of guidance on learning about addressing ill-defined problems in undergraduate bi- ology education. Two groups of college students used an online labo- ratory named VERA to learn about ill-defined ecological phenomena. While one group received guidance, such as giving the learners a specific problem and instruction on problem-solving methods, the other group re- ceived minimal guidance. The results indicate that, while performance in a problem-solving task was not different between groups receiving more vs. minimal guidance, the group that received minimal guidance adopted a more exploratory strategy and generated more interesting models of the given phenomena in a problem-solving task.
more »
« less
- Award ID(s):
- 1636848
- PAR ID:
- 10333012
- Date Published:
- Journal Name:
- Proceedings of the 18th International Conference on Intelligent Tutoring Systems.
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Spatial reasoning skills have been linked to success in STEM and are considered an important part of geoscience problem solving. Most agree that these are a group of skills rather than a single ability, though there is no agreement on the full list of constituent skills. Few studies have attempted to isolate specific spatial skills for deliberate training. We conducted an experiment to isolate and train the skill of recognizing horizontal (a crucial component in measuring the orientation of planes) using a dedicated Virtual Reality (VR) module. We recruited 21 undergraduate students from natural science and social science majors for the study, which consisted of a pretest, 15-minute training, and posttest. The pre- and posttests consisted of a short multiple choice vocabulary quiz, 5 hand-drawn and 5 multiple choice Water Level Task (WLT) questions, and the Vandenberg and Kuse Mental Rotation Task (MRT). Participants were sorted based on pre-test Water Level Task scores, only those with scores <80% were placed in an intervention group and randomly assigned to training, either in VR (experimental) or on paper (standard), of about 15 minutes. The high-scoring participants received no training (comparison). All three groups of participants completed a posttest after the training (if any). After removing three participants who did not return for the posttest session, we had 18 participants in total: 6 in VR, 7 in the comparison group, and 5 in the standard group. Repeated measures ANOVA of the pre to post hand-drawn WLT scores shows at least one group is different (p=.002) and Tukey’s Post-Hoc analysis indicates that the VR group improved significantly more that the high-scoring comparison group (Mean Difference = -1.857, p = .001) and the standard group (Mean Difference = -1.200, p = .049). While any significant result is encouraging, a major limitation of this study is the small sample size and unequal variances on both the pretest (Levene’s HOV test, F = 7.50, p = .006) and posttest (F = 13.53, p < .001), despite random assignment. More trials are needed to demonstrate reproducibility. While more tests are needed, this preliminary study shows the potential benefit of VR in training spatial reasoning skills.more » « less
-
Workplace engineering problems are different from the problems that undergraduate engineering students typically encounter in most classroom settings. Students are most commonly given well-structured problems which have clear solution paths along with well-defined constraints and goals. This paper reports on research that examines how undergraduate engineering students perceived solving an ill-structured problem. Eighteen undergraduate civil engineering students were asked to solve an ill-structured engineering problem, and were interviewed after they completed solving the problem. This qualitative study is guided by the following research question: What factors do students perceive to influence their solving of an ill-structured civil engineering problem? Students’ responses to seven follow-up interview questions were transcribed and reviewed by research team members, which were used to develop codes and themes associated with these responses. Students’ transcripts were then coded following the developed codes. The analysis of data revealed that students were generally aware of the main positives and negatives of their proposed solutions to the ill-structured problem and reported that their creativity influenced their solutions and problem solving processes. Student responses also indicated that specific life events such as classes that they had taken, personal experiences, and exposure to other ill-structured problems during an internship helped them develop their proposed solution. Given students’ responses and overall findings, this supports creating learning environments for engineering students where they can support increasing their creativity and be more exposed to complex engineering problems.more » « less
-
Abstract The response process of problem‐solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data‐driven approach to explore the latent states and state transitions underlying problem‐solving process to reflect test‐takers' behavioural patterns, and to investigate how these states and state transitions could be associated with test‐takers' performance. We employed the Hidden Markov Modelling approach to identify test takers' hidden states during the problem‐solving process and compared the frequency of states and/or state transitions between different performance groups. We conducted comparable studies in two problem‐solving items with a focus on the US sample that was collected in PIAAC 2012, and examined the correlation between those frequencies from two items. Latent states and transitions between them underlying the problem‐solving process were identified and found significantly different by performance groups. The groups with correct responses in both items were found more engaged in tasks and more often to use efficient tools to solve problems, while the group with incorrect responses was found more likely to use shorter action sequences and exhibit hesitative behaviours. Consistent behavioural patterns were identified across items. This study demonstrates the value of data‐driven based HMM approach to better understand respondents' behavioural patterns and cognitive transmissions underneath the observable action sequences in complex problem‐solving tasks.more » « less
-
We model collaborative problem solving outcomes using data from 37 triads who completed a challenging computer programming task. Participants individually rated their group’s performance, communication, cooperation, and agreeableness after the session, which were aggregated to produce group-level measures of subjective outcomes. We scored teams on objective task outcomes and measured individual students’ learning outcomes with a posttest. Groups with similar personalities performed better on the task and had higher ratings of communication, cooperation, and agreeableness. Importantly, greater deviation in teammates’ perception of group performance and higher ratings of communication, cooperation, and agreeableness negatively predicted individual learning. We discuss findings from the perspective of group work norms and consider applications to intelligent systems that support collaborative problem solving.more » « less