skip to main content


Title: How are students' online learning behavior related to their course outcomes in an introductory physics course?
This study investigates patterns in students' learning and problem-solving behavior as they proceed through a sequence of 10 mastery-based online learning modules and how these patterns correlate with overall course outcome. Students' interaction with each module, as measured by analyzing the platform log data, was categorized into nine different states. The student population was divided into top, middle and bottom cohorts based on their total course credit, and we visualized each cohort's distribution among the nine states over the 10 modules using a series of parallel coordinates graphs. We found that the patterns of interaction were mostly similar on the first six modules, but are significantly different on modules 7-10. For the later modules, the top cohort mostly concentrated on the state corresponding to high problem-solving effort after learning, while the majority of the bottom cohort did not access the learning materials after multiple failed attempts.  more » « less
Award ID(s):
1845436
NSF-PAR ID:
10133048
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Physics Education Research Conference 2019
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Generally, the focus of undergraduate engineering programs is on the development of technical skills and how they can be applied to design and problem solving. However, research has shown that there is also a need to expose students to business and society factors that influence design in context. This technical bias is reinforced by the available tools for use in engineering education, which are highly focused on ensuring technical feasibility, and a corresponding lack of tools for engineers to explore other design needs. One important contextual area is market systems, where design decisions are made while considering factors such as consumer choice, competitor behavior, and pricing. This study examines student learning throughout a third-year design course that emphasizes market-driven design through project-based activities and assignments, including a custom-made, interactive market simulation tool. To bridge the gap between market-driven design and engineering education research, this paper explores how students think about and internally organize design concepts before and after learning and practicing market-driven design approaches and tools in the context of an engineering design course. The central research question is: In what ways do student conceptions of product design change after introducing a market-driven design curriculum? In line with the constructivism framework of learning, it is expected that student conceptions of design should evolve to include more market considerations as they learn about and apply market-driven design concepts and techniques to their term projects. Four different types of data instruments are included in the analysis: Concept maps generated by the students before and after the course, open-ended written reflection assignments at various points in the semester, surveys administered after learning the market simulation tool and at the end of the course, and final project reports in which student teams listed their top 3-5 lessons learned in the course. Using the changes between the pre- and post-course concept maps as the primary metric to represent evolving design conceptions, data from the reflections, surveys, and reports are evaluated to assess their influence on such learning. Because market-driven design is a multi-faceted topic, a market-driven design is hierarchically decomposed into specific sub-topics for these evaluations. These include profitability (which itself encompasses pricing and costs), modeling and simulation, and market research (which encompasses consumers and competition). For each topic, correlation analyses are performed and regression models are fit to assess the significance of different factors on learning. The findings provide evidence regarding the effectiveness of the course’s market-driven design curriculum and activities on influencing student conceptions of design. 
    more » « less
  2. Generally, the focus of undergraduate engineering programs is on the development of technical skills and how they can be applied to design and problem solving. However, research has shown that there is also a need to expose students to business and society factors that influence design in context. This technical bias is reinforced by the available tools for use in engineering education, which are highly focused on ensuring technical feasibility, and a corresponding lack of tools for engineers to explore other design needs. One important contextual area is market systems, where design decisions are made while considering factors such as consumer choice, competitor behavior, and pricing. This study examines student learning throughout a third-year design course that emphasizes market-driven design through project-based activities and assignments, including a custom-made, interactive market simulation tool. To bridge the gap between market-driven design and engineering education research, this paper explores how students think about and internally organize design concepts before and after learning and practicing market-driven design approaches and tools in the context of an engineering design course. The central research question is: In what ways do student conceptions of product design change after introducing a market-driven design curriculum? In line with the constructivism framework of learning, it is expected that student conceptions of design should evolve to include more market considerations as they learn about and apply market-driven design concepts and techniques to their term projects. Four different types of data instruments are included in the analysis: Concept maps generated by the students before and after the course, open-ended written reflection assignments at various points in the semester, surveys administered after learning the market simulation tool and at the end of the course, and final project reports in which student teams listed their top 3-5 lessons learned in the course. Using the changes between the pre- and post-course concept maps as the primary metric to represent evolving design conceptions, data from the reflections, surveys, and reports are evaluated to assess their influence on such learning. Because market-driven design is a multi-faceted topic, a market-driven design is hierarchically decomposed into specific sub-topics for these evaluations. These include profitability (which itself encompasses pricing and costs), modeling and simulation, and market research (which encompasses consumers and competition). For each topic, correlation analyses are performed and regression models are fit to assess the significance of different factors on learning. The findings provide evidence regarding the effectiveness of the course’s market-driven design curriculum and activities on influencing student conceptions of design. 
    more » « less
  3. Innovation training is considered critical for the future of our country, yet despite the important role, opportunities for students to develop innovation skills are limited. For STEM students, training in innovation principles and processes are frequently extra curricular pursuits, such as unpaid internships with start up organizations, shadowing innovation professionals, or obtaining an additional business degree or minor covering innovation principles. The National Science Foundation has funded the authors with a Science, Technology, Engineering and Mathematics (S STEM) grant to provide scholarships combined with research on best practices for recruitment, retention, and development of innovation skills for a diverse group of low income undergraduate students. Students in the program come from STEM disciplines in engineering and the physical sciences however, business students are also integrated into innovation courses although they are not funded by the S STEM grant Design, development, and implementation of the grant funded program’s first innovation related course, a 2 week fall intercession course will be presented Th is first year course is designed to provide the students with an introduction to innovation, develop and nurture the students’ innovation mindset and skills, and also help the students’ successful transition to college. The first-year two-week intercession course was designed and developed with two credit hours focusing on content related to innovation and one credit hour focusing on student success topics. The significant academic course components included: 1) interactive active-learning modules related to innovation processes, identifying where good ideas come from, working in teams, leadership, project management, and communication and presentation skills; 2) team innovation projects, one topic-assigned, applying skills learned in the content modules to develop innovation and team collaboration skills; and 3) integration of business students with STEM students which together gives viewpoints and experiences on product and customer needs. It is important to our nation’s health and safety to instill innovation in our students. In addition, today’s students are interested in innovation and in learning how to apply innovation techniques in their professional and personal lives. The course was designed for teams of four STEM students to one business student which provides a balanced input needed for this type of project taking into account the skillset of the technically oriented STEM students and the marketing-oriented business students, as well as personality types. This ensures that all voices are heard, and topical areas are addressed. There was no problem in getting faculty interest in developing the course, and the collaboration between retention professionals and faculty went well. After the course, an iterative improvement retrospective will be performed on the program as implemented to this point to inform improvements for next year’s cohort. This material is based upon work supported by the National Science Foundation under Grant No. 2030297. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. 
    more » « less
  4. null (Ed.)
    This full research-track paper demonstrates growth in computational thinking in a cohort of engineering students completing their first course in engineering at a large Southwestern university in the United States. Computational thinking has been acknowledged as a key aspect of engineering education and an intrinsic part of multiple ABET outcomes. However, computing is an area where some students have more privileges (e.g. access and exposure to meaningful use of computers) than others. Integrating computing into engineering, especially early in the curriculum, may exacerbate existing experiential disadvantages students from excluded social identities experience. Most introductory engineering programs have a component of programming and/or computational thinking. A comprehensive literature review showed that no existing computational thinking framework fully met the needs of students and professors in engineering and computer science. As a result, this team created the Engineering Computational Thinking Diagnostic (ECTD). This diagnostic was assessed and improved during the 2019-2020 academic year. Data was collected from a cohort in a first-year engineering course that included topics in mathematics, engineering problem solving, and computation. Pre- and post-test data analysis with 62 participants documents statistically significant student growth in computational thinking in this course. Significant differences were not found by gender or a limited racially-based analysis. This diagnostic is of interest and relevance to all institutions providing engineering and computing programs. The short-term impact of this research includes an innovative approach to gauge student abilities in computational thinking early in a course in order to add appropriate intervention activities into lesson plans. The long-term impact is the creation of a measurement of student learning of computational thinking in engineering for courses and programs that wish to develop this important skill in their students. 
    more » « less
  5. null (Ed.)
    Engineering graduates need a deep understanding of key concepts in addition to technical skills to be successful in the workforce. However, traditional methods of instruction (e.g., lecture) do not foster deep conceptual understanding and make it challenging for students to learn the technical skills, (e.g., professional modeling software), that they need to know. This study builds on prior work to assess engineering students’ conceptual and procedural knowledge. The results provide an insight into how the use of authentic online learning modules influence engineering students’ conceptual knowledge and procedural skills. We designed online active learning modules to support and deepen undergraduate students’ understanding of key concepts in hydrology and water resources engineering (e.g., watershed delineation, rainfall-runoff processes, design storms), as well as their technical skills (e.g., obtaining and interpreting relevant information for a watershed, proficiency using HEC-HMS and HEC-RAS modeling tools). These modules integrated instructional content, real data, and modeling resources to support students’ solving of complex, authentic problems. The purpose of our study was to examine changes in students’ self-reported understanding of concepts and skills after completing these modules. The participants in this study were 32 undergraduate students at a southern U.S. university in a civil engineering senior design course who were assigned four of these active learning modules over the course of one semester to be completed outside of class time. Participants completed the Student Assessment of Learning Gains (SALG) survey immediately before starting the first module (time 1) and after completing the last module (time 2). The SALG is a modifiable survey meant to be specific to the learning tasks that are the focus of instruction. We created versions of the SALG for each module, which asked students to self-report their understanding of concepts and ability to implement skills that are the focus of each module. We calculated learning gains by examining differences in students’ self-reported understanding of concepts and skills from time 1 to time 2. Responses were analyzed using eight paired samples t-tests (two for each module used, concepts and skills). The analyses suggested that students reported gains in both conceptual knowledge and procedural skills. The data also indicated that the students’ self-reported gain in skills was greater than their gain in concepts. This study provides support for enhancing student learning in undergraduate hydrology and water resources engineering courses by connecting conceptual knowledge and procedural skills to complex, real-world problems. 
    more » « less