skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, February 13 until 2:00 AM ET on Friday, February 14 due to maintenance. We apologize for the inconvenience.


Title: Using machine learning to predict engineering technology students’ success with computer‐aided design
Computer-aided design (CAD) programs are essential to engineering as they allow for better designs through low-cost iterations. While CAD programs are typically taught to undergraduate students as a job skill, such software can also help students learn engineering concepts. A current limitation of CAD programs (even those that are specifically designed for educational purposes) is that they are not capable of providing automated real-time help to students. To encourage CAD programs to build in assistance to students, we used data generated from students using a free, open-source CAD software called Aladdin to demonstrate how student data combined with machine learning techniques can predict how well a particular student will perform in a design task. We challenged students to design a house that consumed zero net energy as part of an introductory engineering technology undergraduate course. Using data from 128 students, along with the scikit-learn Python machine learning library, we tested our models using both total counts of design actions and sequences of design actions as inputs. We found that our models using early design sequence actions are particularly valuable for prediction. Our logistic regression model achieved a >60% chance of predicting if a student would succeed in designing a zero net energy house. Our results suggest that it would be feasible for Aladdin to provide useful feedback to students when they are approximately halfway through their design. Further improvements to these models could lead to earlier predictions and thus provide students feedback sooner to enhance their learning.  more » « less
Award ID(s):
2105695
PAR ID:
10312977
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
Computer Applications in Engineering Education
ISSN:
1061-3773
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Insufficient engineering analysis is a common weakness of student capstone design projects. Efforts made earlier in a curriculum to introduce analysis techniques should improve student confidence in applying these important skills toward design. To address student shortcomings in design, we implemented a new design project assignment for second-year undergraduate biomedical engineering students. The project involves the iterative design of a fracture fixation plate and is part of a broader effort to integrate relevant hands-on projects throughout our curriculum. Students are tasked with (1) using computer-aided design (CAD) software to make design changes to a fixation plate, (2) creating and executing finite element models to assess performance after each change, (3) iterating through three design changes, and (4) performing mechanical testing of the final device to verify model results. Quantitative and qualitative methods were used to assess student knowledge, confidence, and achievement in design. Students exhibited design knowledge gains and cognizance of prior coursework knowledge integration into their designs. Further, students self-reported confidence gains in approaching design, working with hardware and software, and communicating results. Finally, student self-assessments exceeded instructor assessment of student design reports, indicating that students have significant room for growth as they progress through the curriculum. Beyond the gains observed in design knowledge, confidence, and achievement, the fracture fixation project described here builds student experience with CAD, finite element analysis, 3D printing, mechanical testing, and design communication. These skills contribute to the growing toolbox that students ultimately bring to capstone design. 
    more » « less
  2. Abstract

    Biodiversity is a complex, yet essential, concept for undergraduate students in ecology and other natural sciences to grasp. As beginner scientists, students must learn to recognize, describe, and interpret patterns of biodiversity across various spatial scales and understand their relationships with ecological processes and human influences. It is also increasingly important for undergraduate programs in ecology and related disciplines to provide students with experiences working with large ecological datasets to develop students’ data science skills and their ability to consider how ecological processes that operate at broader spatial scales (macroscale) affect local ecosystems. To support the goals of improving student understanding of macroscale ecology and biodiversity at multiple spatial scales, we formed an interdisciplinary team that included grant personnel, scientists, and faculty from ecology and spatial sciences to design a flexible learning activity to teach macroscale biodiversity concepts using large datasets from the National Ecological Observatory Network (NEON). We piloted this learning activity in six courses enrolling a total of 109 students, ranging from midlevel ecology and GIS/remote sensing courses, to upper‐level conservation biology. Using our classroom experiences and a pre/postassessment framework, we evaluated whether our learning activity resulted in increased student understanding of macroscale ecology and biodiversity concepts and increased familiarity with analysis techniques, software programs, and large spatio‐ecological datasets. Overall, results suggest that our learning activity improved student understanding of biological diversity, biodiversity metrics, and patterns of biodiversity across several spatial scales. Participating faculty reflected on what went well and what would benefit from changes, and we offer suggestions for implementation of the learning activity based on this feedback. This learning activity introduced students to macroscale ecology and built student skills in working with big data (i.e., large datasets) and performing basic quantitative analyses, skills that are essential for the next generation of ecologists.

     
    more » « less
  3. Students are often tasked in engaging with activities where they have to learn skills that are tangential to the learning outcomes of a course, such as learning a new software. The issue is that instructors may not have the time or the expertise to help students with such tangential learning. In this paper, we explore how AI-generated feedback can provide assistance. Specifically, we study this technology in the context of a constructionist curriculum where students learn about experimental research through the creation of a gamified experiment. The AI-generated feedback gives a formative assessment on the narrative design of student-designed gamified experiments, which is important to create an engaging experience. We find that students critically engaged with the feedback, but that responses varied among students. We discuss the implications for AI-generated feedback systems for tangential learning. 
    more » « less
  4. Undergraduate and graduate students need professional development skills to form expertise applicable to any job or future career. Mentoring is a way that students can learn how to engage in professional development. Likewise, students can learn professional development skills from mentors who they look to for expanding their knowledge base. To help address the needs of undergraduate and graduate students in engineering, the principal investigator developed and facilitated the Mentoring and Professional Development in Engineering Education (MPD-E2) Program. For this study, we examined the program’s general functions and elements using session notes and discussion of our observations. The guiding research question for this study is: what are some elements of a mentoring and professional development program that students value? In this work, we present details about the elements of the program that support student development and insights about potential future opportunities for these types of programs. 
    more » « less
  5. First-year engineering students are often introduced to the engineering design process through project-based learning situated in a concrete design context. Design contexts like mechanical engineering are commonly used, but students and teachers may need more options. In this article, we show how sustainable building design can serve as an alternative for students of diverse backgrounds and with various interests. The proposed Net Zero Energy Challenge is an engineering design project in which students practice the full engineering design cycle to create a virtual house that generates renewable energy on-site, with the goal to achieve net zero energy consumption. Such a design challenge is made possible by Aladdin, an integrated tool that supports building design, simulation, and analysis within a single package. A pilot study of the Net Zero Energy Challenge at a university in Mid-Atlantic United States suggests that around half of the students were able to achieve the design goal. 
    more » « less