skip to main content


Title: Impact of a Modeling Intervention in an Introductory Programming Course
This complete research paper describes the impact of a modeling intervention on first-year engineering students’ modeling skills in an introductory computer programming course. Five sections of the first-year engineering introductory programming course at a private, STEM+Business institution were revised to center around modeling concepts. These five sections made up the experimental group for this study. The comparison group consisted of four sections of the course that were not revised. Students in all these sections were given two different versions of a modeling problem two times in the semester to test their progress in gaining modeling skills. Each version required two submissions – a written solution and a coded solution. The assessment of these four submissions based on the three established dimensions of modeling were quantitatively analyzed in this study. The three dimensions within mathematical modeling that were the focus of this study were mathematical model complexity, modifiability, and reusability. Mathematical model complexity is being able to address the complexity of the problem. Modifiability addresses the generalizability of the model solution. Reusability is showing an understanding of the problem and the user. Statistical analysis showed that students in the experimental group had more gains in their demonstrated modeling abilities across all three dimensions than the students in the comparison group. This study demonstrated that intentional and explicit instructional strategies targeting model development resulted in greater gains in students’ demonstrated modeling skills and both their written and coded solutions to a complex modeling problem.  more » « less
Award ID(s):
1827392
NSF-PAR ID:
10097551
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
American Society for Engineering Education (ASEE) 126th Annual Conference and Exposition
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Engineers must understand how to build, apply, and adapt various types of models in order to be successful. Throughout undergraduate engineering education, modeling is fundamental for many core concepts, though it is rarely explicitly taught. There are many benefits to explicitly teaching modeling, particularly in the first years of an engineering program. The research questions that drove this study are: (1) How do students’ solutions to a complex, open-ended problem (both written and coded solutions) develop over the course of multiple submissions? and (2) How do these developments compare across groups of students that did and did not participate in a course centered around modeling?. Students’ solutions to an open-ended problem across multiple sections of an introductory programming course were explored. These sections were all divided across two groups: (1) experimental group - these sections discussed and utilized mathematical and computational models explicitly throughout the course, and (2) comparison group - these sections focused on developing algorithms and writing code with a more traditional approach. All sections required students to complete a common open-ended problem that consisted of two versions of the problem (the first version with smaller data set and the other a larger data set). Each version had two submissions – (1) a mathematical model or algorithm (i.e. students’ written solution potentially with tables and figures) and (2) a computational model or program (i.e. students’ MATLAB code). The students’ solutions were graded by student graders after completing two required training sessions that consisted of assessing multiple sample student solutions using the rubrics to ensure consistency across grading. The resulting assessments of students’ works based on the rubrics were analyzed to identify patterns students’ submissions and comparisons across sections. The results identified differences existing in the mathematical and computational model development between students from the experimental and comparison groups. The students in the experimental group were able to better address the complexity of the problem. Most groups demonstrated similar levels and types of change across the submissions for the other dimensions related to the purpose of model components, addressing the users’ anticipated needs, and communicating their solutions. These findings help inform other researchers and instructors how to help students develop mathematical and computational modeling skills, especially in a programming course. This work is part of a larger NSF study about the impact of varying levels of modeling interventions related to different types of models on students’ awareness of different types of models and their applications, as well as their ability to apply and develop different types of models. 
    more » « less
  2. Engineers must understand how to build, apply, and adapt various types of models in order to be successful. Throughout undergraduate engineering education, modeling is fundamental for many core concepts, though it is rarely explicitly taught. There are many benefits to explicitly teaching modeling, particularly in the first years of an engineering program. The research questions that drove this study are: (1) How do students’ solutions to a complex, open-ended problem (both written and coded solutions) develop over the course of multiple submissions? and (2) How do these developments compare across groups of students that did and did not participate in a course centered around modeling?. Students’ solutions to an open-ended problem across multiple sections of an introductory programming course were explored. These sections were all divided across two groups: (1) experimental group - these sections discussed and utilized mathematical and computational models explicitly throughout the course, and (2) comparison group - these sections focused on developing algorithms and writing code with a more traditional approach. All sections required students to complete a common open-ended problem that consisted of two versions of the problem (the first version with smaller data set and the other a larger data set). Each version had two submissions – (1) a mathematical model or algorithm (i.e. students’ written solution potentially with tables and figures) and (2) a computational model or program (i.e. students’ MATLAB code). The students’ solutions were graded by student graders after completing two required training sessions that consisted of assessing multiple sample student solutions using the rubrics to ensure consistency across grading. The resulting assessments of students’ works based on the rubrics were analyzed to identify patterns students’ submissions and comparisons across sections. The results identified differences existing in the mathematical and computational model development between students from the experimental and comparison groups. The students in the experimental group were able to better address the complexity of the problem. Most groups demonstrated similar levels and types of change across the submissions for the other dimensions related to the purpose of model components, addressing the users’ anticipated needs, and communicating their solutions. These findings help inform other researchers and instructors how to help students develop mathematical and computational modeling skills, especially in a programming course. This work is part of a larger NSF study about the impact of varying levels of modeling interventions related to different types of models on students’ awareness of different types of models and their applications, as well as their ability to apply and develop different types of models. 
    more » « less
  3. Security is a critical aspect in the design, development, and testing of software systems. Due to the increasing need for security-related skills within software systems and engineering, there is a growing demand for these skills to be taught at the university level. A series of 41 security modules was developed to assess the impact of these modules on teaching critical cyber security topics to students. This paper presents the implementation and outcomes of the first set of six security modules in a Freshman level course. This set consists of five modules presented in lectures as well as a sixth module emphasizing encryption and decryption used as the semester project for the course. Each module is a collection of concepts related to cyber security. The individual cyber security concepts are presented with a general description of a security issue to avoid, sample code with the security issue written in the Java programming language, and a second version of the code with an effective solution. The set of these modules was implemented in Computer Science I during the Fall 2019 semester. Incorporating each of the concepts in these modules into lectures depends on both the topic covered and the approach to resolving the related security issue. Students were introduced to computing concepts related to both the security issue and the appropriate solution to fully grasp the overall concept. After presenting the materials to students, continual review with students is also essential. This reviewal process requires exploring use-cases for the programming mechanisms presented as solutions to the security issues discussed. In addition to the security modules presented in lectures, students were given a hands-on approach to understanding the concepts through Model-Eliciting Activities (MEAs). MEAs are open-ended, problem-solving activities in which groups of three to four students work to solve realistic complex problems in a classroom setting. The semester project related to encryption and decryption was implemented into the course as an MEA. To assess the effectiveness of incorporating security modules with the MEA project into the curriculum of Computer Science I, two sections of the course were used as a control group and a treatment group. The treatment group included the security modules in lectures and the MEA project while the control group did not. To measure the overall effectiveness of incorporating security modules with the MEA project, both the instructor’s effectiveness as well as the student’s attitudes and interest were measured. For instructors, the primary question to address was to what extent do instructors change their attitudes towards student learning and their teaching practices because of the implementation of cyber security modules through MEAs. For students, the primary question to address was how the inclusion of security modules with the MEA project improved their understanding of the course materials and their interests in computer science. After implementing security modules with the MEA project, students showed a better understanding of cyber security concepts and a greater interest in broader computer science concepts. The instructor’s beliefs about teaching, learning, and assessment shifted from teacher-centered to student-centered, during his experience with the security modules and MEA. 
    more » « less
  4. The social/technical dualism in the engineering curriculum leaves students ill-prepared to tackle real-world technical problems in their social, economic, and political contexts (Cech, 2013; Faulkner, 2007; Trevelan, 2010, 2014). Increasingly, students have expressed the desire for their technical courses to show the interplay between social and technical considerations (Leydens & Lucena, 2017), but they have few opportunities to develop these sociotechnical ways of thinking (i.e., values, attitudes, and skills that integrate the social and technical). Instead, students are left to infer engineering as technically neutral through the instructional decisions that make up an engineering curriculum (Cech, 2013; Trevelan, 2014). In this study, we focus on how students understand the role of sociotechnical thinking in engineering. Particularly, this study centers seven minoritized students in an introductory engineering computation class who are pursuing an engineering degree. The study takes place at a medium private university in New England. These seven students are from a group of roughly seventy students split between two of the five sections for the course. These two sections were recently revised to include more sociotechnical readings, discussions, and homework facilitated with learning assistants. We are interested in understanding the self-described sense of belonging that these students feel as they relate it to learning about engineering as a sociotechnical field. While the dualism between engineering's technical and social dimensions has been studied in ASEE LEES papers, articles in Engineering Studies, broader engineering education research, and Science, Technology, and Science publications (e.g., Cech, 2013; Faulkner, 2007; Leydens & Lucena, 2017; Riley, 2017; Wisnioski, 2012), there is a need to connect this vast literature with the similarly extensive research on students' sense of belonging and engineering identity development, specifically for those students who have historically been excluded from engineering. Specifically, we draw on W.E.B. DuBois's notion of a 'double consciousness' from the Souls of Black Folks (1903) as a lens through which to understand how these seven students take on the political, economic, and social dimensions presented to them through a first-year engineering curricular redesign around engineering as sociotechnical. We note the small-n design of this study (Slaton & Pawley, 2018). The seven interviewed students are gender and racial minorities in engineering. However, we note that they do not represent all minoritized students in engineering, and to respect and elevate their experiences, we take a narrative approach. This study is intended to center the perspectives and experiences of these seven students as they navigate an engineering learning environment. We do not intend for the findings to be generalizable or exhaustive but informative as we think about scaling up the sociotechnical curricular redesign in engineering at this university and more broadly. 
    more » « less
  5. This NSF-IUSE exploration and design project began in fall 2018 and features cross-disciplinary collaboration between engineering, math, and psychology faculty to develop learning activities with hands-on models and manipulatives. We are exploring how best to design these activities to support learners’ development of conceptual understanding and representational competence in integral calculus and engineering statics, two foundational courses for most engineering majors. A second goal is to leverage the model-based activities to scaffold spatial skills development in the context of traditional course content. As widely reported in the literature, well-developed spatial abilities correlate with student success and persistence in many STEM majors. We provided calculus students in selected intervention sections taught by four instructors at three different community colleges with take-home model kits that they could reference for a series of asynchronous learning activities. Students in these sections completed the Purdue Spatial Visualization Test: Rotations (PSVT:R) in the first and last weeks of their course. We also administered the assessment in multiple control sections (no manipulatives) taught by the same faculty. This paper analyzes results from fall 2020 through fall 2021 to see if there is any difference between control and intervention sections for the courses as a whole and for demographic subgroups including female-identifying students and historically-underserved students of color. All courses were asynchronous online modality in the context of the COVID-19 pandemic. We find that students in intervention sections of calculus made slightly larger gains on the PSVT:R, but this result is not statistically significant as a whole or for any of the demographic subgroups considered. We also analyzed final course grades for differences between control and intervention sections and found no differences. We found no significant effect of the presence of the model-based activities leading to increased PSVT:R gains or improved course grades. We would not extend this conclusion to face-to-face implementation, however, due primarily to the compromises made to adapt the curriculum from in-person group learning to asynchronous individual work and inconsistent engagement of the online students with the modeling activities. 
    more » « less