An official website of the United States government
In this study we use latent class analysis, distractor analysis, and qualitative analysis of cognitive interviews of student responses to questions on an algebra concept inventory, in order to generate theories about how students’ selections of specific answer choices may reflect different stages or types of algebraic conceptual understanding. Our analysis reveals three groups of students in elementary algebra courses, which we label as “mostly random guessing”, “some procedural fluency with key misconceptions”, and “procedural fluency with emergent conceptual understanding”. Student responses also revealed high rates of misconceptions that stem from misuse or misunderstanding of procedures, and whose prevalence often correlates with higher levels of procedural fluency.
more »
« less
Describing the Development of the Assessment of Biological Reasoning (ABR)
Assessments of scientific reasoning that capture the intertwining aspects of conceptual, procedural and epistemic knowledge are often associated with intensive qualitative analyses of student responses to open-ended questions, work products, interviews, discourse and classroom observations. While such analyses provide evaluations of students’ reasoning skills, they are not scalable. The purpose of this study is to develop a three-tiered multiple-choice assessment to measure students’ reasoning about biological phenomena and to understand the affordances and limitations of such an assessment. To validate the assessment and to understand what the assessment measures, qualitative and quantitative data were collected and analyzed, including read-aloud, focus group interviews and analysis of large sample data sets. These data served to validate our three-tiered assessment called the Assessment of Biological Reasoning (ABR) consisting of 10 question sets focused on core biological concepts. Further examination of our data suggests that students’ reasoning is intertwined in such a way that procedural and epistemic knowledge is reliant on and given meaning by conceptual knowledge, an idea that pushes against the conceptualization that the latter forms of knowledge construction are more broadly applicable across disciplines.
more »
« less
- Award ID(s):
- 1720587
- PAR ID:
- 10329723
- Editor(s):
- Krell, M.; Vorholzer, A.; Nehring, A.
- Date Published:
- Journal Name:
- Education sciences
- Volume:
- 11
- Issue:
- 11
- ISSN:
- 2227-7102
- Page Range / eLocation ID:
- 669-689
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Frank, Brian W.; Jones, Dyan L.; Ryan, Qing X. (Ed.)Learning physics in any context, including undergraduate research experiences (UREs), requires learning its concepts and the relational structure between those new concepts with what students already know. We use concept maps, a knowledge elicitation method, for assessing mentees' and mentors' knowledge structures during Research Experience for Undergraduates programs. The study looked at maps from seven mentor-mentee pairs to understand how mentors and mentees use specific knowledge and strategies during the development of their concept maps. A qualitative analysis of the maps showed mentors and mentees differed in their ways of organizing and displaying their knowledge in terms of structure, scale, language, and use of conceptual and procedural knowledge. For instance, mentees used more procedural knowledge. It is perhaps due to their perception of finishing their REU projects and the fact that they may have only limited and superficial knowledge of specific topics. However, mentors' maps were smaller but more significant in using more comprehensive conceptual knowledge and connecting their maps to the broader scientific context.more » « less
-
null (Ed.)Learning is usually conceptualized as a process during which new information is processed in working memory to form knowledge structures called schemas, which are stored in long-term memory. Practice plays a critical role in developing schemas through learning-by-doing. Contemporary expertise development theories have highlighted the influence of deliberate practice (DP) on achieving exceptional performance in sports, music, and different professional fields. Concurrently, there is an emerging method for improving learning efficiency by combining deliberate practice with cognitive load theory (CLT), a cognition-architecture-based theory for instructional design. Mechanics is a foundation for most branches of engineering. It serves to develop problem-solving skills and consolidate understanding of other subjects, such as applied mathematics and physics. Mechanics has been a challenging subject. Students need to understand governing principles to gain conceptual knowledge and acquire procedural knowledge to apply these principles to solve problems. Due to the difficulty in developing conceptual and procedural knowledge, mechanics courses are among those which receive high DFW rates (percentage of students receiving a grade of D or F or Withdrawing from a course) and students are more likely to leave engineering after taking mechanics courses. Since deliberate practice can help novices develop good representations of the knowledge needed to produce superior problem solving performance, this study is to evaluate how deliberate practice helps students learn mechanics during the process of schema acquisition and consolidation. Considering cognitive capacity limitations, we will apply cognitive load theory to develop deliberate practice to help students build declarative and procedural knowledge without exceeding their working memory limitations. We will evaluate the effects of three practice strategies based on CLT on the schema acquisition and consolidation in two mechanics courses (i.e., Statics and Dynamics). Examples and assessment results will be provided to evaluate the effectiveness of the practice strategies as well as the challenges.more » « less
-
Learning is usually conceptualized as a process during which new information is processed in working memory to form knowledge structures called schemas, which are stored in long-term memory. Practice plays a critical role in developing schemas through learning-by-doing. Contemporary expertise development theories have highlighted the influence of deliberate practice (DP) on achieving exceptional performance in sports, music, and different professional fields. Concurrently, there is an emerging method for improving learning efficiency by combining deliberate practice with cognitive load theory (CLT), a cognition-architecture-based theory for instructional design. Mechanics is a foundation for most branches of engineering. It serves to develop problem-solving skills and consolidate understanding of other subjects, such as applied mathematics and physics. Mechanics has been a challenging subject. Students need to understand governing principles to gain conceptual knowledge and acquire procedural knowledge to apply these principles to solve problems. Due to the difficulty in developing conceptual and procedural knowledge, mechanics courses are among those which receive high DFW rates (percentage of students receiving a grade of D or F or Withdrawing from a course) and students are more likely to leave engineering after taking mechanics courses. Since deliberate practice can help novices develop good representations of the knowledge needed to produce superior problem solving performance, this study is to evaluate how deliberate practice helps students learn mechanics during the process of schema acquisition and consolidation. Considering cognitive capacity limitations, we will apply cognitive load theory to develop deliberate practice to help students build declarative and procedural knowledge without exceeding their working memory limitations. We will evaluate the effects of three practice strategies based on CLT on schema acquisition and consolidation in two mechanics courses (i.e., Statics and Dynamics). Examples and assessment results will be provided to evaluate the effectiveness of the practice strategies as well as the challenges.more » « less
-
null (Ed.)Engineering graduates need a deep understanding of key concepts in addition to technical skills to be successful in the workforce. However, traditional methods of instruction (e.g., lecture) do not foster deep conceptual understanding and make it challenging for students to learn the technical skills, (e.g., professional modeling software), that they need to know. This study builds on prior work to assess engineering students’ conceptual and procedural knowledge. The results provide an insight into how the use of authentic online learning modules influence engineering students’ conceptual knowledge and procedural skills. We designed online active learning modules to support and deepen undergraduate students’ understanding of key concepts in hydrology and water resources engineering (e.g., watershed delineation, rainfall-runoff processes, design storms), as well as their technical skills (e.g., obtaining and interpreting relevant information for a watershed, proficiency using HEC-HMS and HEC-RAS modeling tools). These modules integrated instructional content, real data, and modeling resources to support students’ solving of complex, authentic problems. The purpose of our study was to examine changes in students’ self-reported understanding of concepts and skills after completing these modules. The participants in this study were 32 undergraduate students at a southern U.S. university in a civil engineering senior design course who were assigned four of these active learning modules over the course of one semester to be completed outside of class time. Participants completed the Student Assessment of Learning Gains (SALG) survey immediately before starting the first module (time 1) and after completing the last module (time 2). The SALG is a modifiable survey meant to be specific to the learning tasks that are the focus of instruction. We created versions of the SALG for each module, which asked students to self-report their understanding of concepts and ability to implement skills that are the focus of each module. We calculated learning gains by examining differences in students’ self-reported understanding of concepts and skills from time 1 to time 2. Responses were analyzed using eight paired samples t-tests (two for each module used, concepts and skills). The analyses suggested that students reported gains in both conceptual knowledge and procedural skills. The data also indicated that the students’ self-reported gain in skills was greater than their gain in concepts. This study provides support for enhancing student learning in undergraduate hydrology and water resources engineering courses by connecting conceptual knowledge and procedural skills to complex, real-world problems.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/educsci11110669
