More Like this

1. Types of Models Identified by First-Year Engineering Students

   Rodgers, K ; Thompson, A ; Verleger, M ; Marbouti, F ; Shah, N ; Thaker, P ( July 2021 , 2021 ASEE Annual Conference)

   null (Ed.)

   This is a Complete Research paper. Understanding models is important for engineering students, but not often taught explicitly in first-year courses. Although there are many types of models in engineering, studies have shown that engineering students most commonly identify prototyping or physical models when asked about modeling. In order to evaluate students’ understanding of different types of models used in engineering and the effectiveness of interventions designed to teach modeling, a survey was developed. This paper describes development of a framework to categorize the types of engineering models that first-year engineering students discuss based on both previous literature and students’ responses to survey questions about models. In Fall 2019, the survey was administered to first-year engineering students to investigate their awareness of types of models and understanding of how to apply different types of models in solving engineering problems. Students’ responses to three questions from the survey were analyzed in this study: 1. What is a model in science, technology, engineering, and mathematics (STEM) fields?, 2. List different types of models that you can think of., and 3. Describe each different type of model you listed. Responses were categorized by model type and the framework was updated through an iterative coding process. After four rounds of analysis of 30 different students’ responses, an acceptable percentage agreement was reached between independent researchers coding the data. Resulting frequencies of the various model types identified by students are presented along with representative student responses to provide insight into students’ understanding of models in STEM. This study is part of a larger project to understand the impact of modeling interventions on students’ awareness of models and their ability to build and apply models. 

   more » « less
2. Developing a Program to Assist in Qualitative Data Analysis: How Engineering Students’ Discuss Model Types

   Rodgers K ; Thompson A ; Hawkins N ; Verleger M ; Marbouti F ( January 2022 , 2022 ASEE Annual Conference)

   This Research paper discusses the opportunities that utilizing a computer program can present in analyzing large amounts of qualitative data collected through a survey tool. When working with longitudinal qualitative data, there are many challenges that researchers face. The coding scheme may evolve over time requiring re-coding of early data. There may be long periods of time between data analysis. Typically, multiple researchers will participate in the coding, but this may introduce bias or inconsistencies. Ideally the same researchers would be analyzing the data, but often there is some turnover in the team, particularly when students assist with the coding. Computer programs can enable automated or semi-automated coding helping to reduce errors and inconsistencies in the coded data. In this study, a modeling survey was developed to assess student awareness of model types and administered in four first-year engineering courses across the three universities over the span of three years. The data collected from this survey consists of over 4,000 students’ open-ended responses to three questions about types of models in science, technology, engineering, and mathematics (STEM) fields. A coding scheme was developed to identify and categorize model types in student responses. Over two years, two undergraduate researchers analyzed a total of 1,829 students’ survey responses after ensuring intercoder reliability was greater than 80% for each model category. However, with much data remaining to be coded, the research team developed a MATLAB program to automatically implement the coding scheme and identify the types of models students discussed in their responses. MATLAB coded results were compared to human-coded results (n = 1,829) to assess reliability; results matched between 81%-99% for the different model categories. Furthermore, the reliability of the MATLAB coded results are within the range of the interrater reliability measured between the 2 undergraduate researchers (86-100% for the five model categories). With good reliability of the program, all 4,358 survey responses were coded; results showing the number and types of models identified by students are presented in the paper. 

   more » « less
3. Comparing students’ solutions to an open-ended problem in an introductory programming course with and without explicit modeling interventions

   https://doi.org/10.18260/1-2--34311  

   Rodgers, Kelsey J. ; Verleger, Matthew A. ; Marbouti, Farshid ( June 2020 , ASEE Annual Conference proceedings)

   Engineers must understand how to build, apply, and adapt various types of models in order to be successful. Throughout undergraduate engineering education, modeling is fundamental for many core concepts, though it is rarely explicitly taught. There are many benefits to explicitly teaching modeling, particularly in the first years of an engineering program. The research questions that drove this study are: (1) How do students’ solutions to a complex, open-ended problem (both written and coded solutions) develop over the course of multiple submissions? and (2) How do these developments compare across groups of students that did and did not participate in a course centered around modeling?. Students’ solutions to an open-ended problem across multiple sections of an introductory programming course were explored. These sections were all divided across two groups: (1) experimental group - these sections discussed and utilized mathematical and computational models explicitly throughout the course, and (2) comparison group - these sections focused on developing algorithms and writing code with a more traditional approach. All sections required students to complete a common open-ended problem that consisted of two versions of the problem (the first version with smaller data set and the other a larger data set). Each version had two submissions – (1) a mathematical model or algorithm (i.e. students’ written solution potentially with tables and figures) and (2) a computational model or program (i.e. students’ MATLAB code). The students’ solutions were graded by student graders after completing two required training sessions that consisted of assessing multiple sample student solutions using the rubrics to ensure consistency across grading. The resulting assessments of students’ works based on the rubrics were analyzed to identify patterns students’ submissions and comparisons across sections. The results identified differences existing in the mathematical and computational model development between students from the experimental and comparison groups. The students in the experimental group were able to better address the complexity of the problem. Most groups demonstrated similar levels and types of change across the submissions for the other dimensions related to the purpose of model components, addressing the users’ anticipated needs, and communicating their solutions. These findings help inform other researchers and instructors how to help students develop mathematical and computational modeling skills, especially in a programming course. This work is part of a larger NSF study about the impact of varying levels of modeling interventions related to different types of models on students’ awareness of different types of models and their applications, as well as their ability to apply and develop different types of models. 

   more » « less
4. Comparing Students’ Solutions to an Open-ended Problem in an Introductory Programming Course with and without Explicit Modeling Interventions

   Rodgers, K ; Verleger, M ; Marbouti, F ( January 2020 , ASEE Annual Conference proceedings)

   Engineers must understand how to build, apply, and adapt various types of models in order to be successful. Throughout undergraduate engineering education, modeling is fundamental for many core concepts, though it is rarely explicitly taught. There are many benefits to explicitly teaching modeling, particularly in the first years of an engineering program. The research questions that drove this study are: (1) How do students’ solutions to a complex, open-ended problem (both written and coded solutions) develop over the course of multiple submissions? and (2) How do these developments compare across groups of students that did and did not participate in a course centered around modeling?. Students’ solutions to an open-ended problem across multiple sections of an introductory programming course were explored. These sections were all divided across two groups: (1) experimental group - these sections discussed and utilized mathematical and computational models explicitly throughout the course, and (2) comparison group - these sections focused on developing algorithms and writing code with a more traditional approach. All sections required students to complete a common open-ended problem that consisted of two versions of the problem (the first version with smaller data set and the other a larger data set). Each version had two submissions – (1) a mathematical model or algorithm (i.e. students’ written solution potentially with tables and figures) and (2) a computational model or program (i.e. students’ MATLAB code). The students’ solutions were graded by student graders after completing two required training sessions that consisted of assessing multiple sample student solutions using the rubrics to ensure consistency across grading. The resulting assessments of students’ works based on the rubrics were analyzed to identify patterns students’ submissions and comparisons across sections. The results identified differences existing in the mathematical and computational model development between students from the experimental and comparison groups. The students in the experimental group were able to better address the complexity of the problem. Most groups demonstrated similar levels and types of change across the submissions for the other dimensions related to the purpose of model components, addressing the users’ anticipated needs, and communicating their solutions. These findings help inform other researchers and instructors how to help students develop mathematical and computational modeling skills, especially in a programming course. This work is part of a larger NSF study about the impact of varying levels of modeling interventions related to different types of models on students’ awareness of different types of models and their applications, as well as their ability to apply and develop different types of models. 

   more » « less
5. First-year engineering students’ identification of models in engineering

   Shah, Nishith ; Thaker, Pujan ; Rodgers, Kelsey J. ; Verleger, Matthew A. ( April 2020 , Discovery Day presented by The Office of Undergraduate Research at Embry-Riddle Aeronautical University)

   Background To succeed in engineering careers, students must be able to create and apply models to certain problems. The different types of models include physical, mathematical, computational, graphical, and financial, which are used both in academics, research, and industry. However, many students struggle to define, create, and apply relevant models in their engineering courses. Purpose (Research Questions) The research questions investigated in this study are: (1) What types of models do engineering students identify before and after completing a first-year engineering course? (2) How do students’ responses compare across different courses (a graphical communications course - EGR 120 and a programming course - EGR 115), and sections? Design/Methods The data used for this study were collected in two introductory first-year engineering courses offered during Fall 2019, EGR 115 and EGR 120. Students’ responses to a survey about modeling were qualitatively analyzed. The survey was given at the beginning and the end of the courses. The data analyzed consisted of 560 pre and post surveys for EGR 115 and 384 pre and post surveys for EGR 120. Results Once the analysis is complete, we are hoping to find that the students can better define and apply models in their engineering courses after they have completed the EGR 115 and/or EGR 120 courses. 

   more » « less