This research paper investigates differences between course design heuristics that have been identified from three distinct data sources: course design team meetings, educator interviews, and course design papers. The study of heuristics used by experts in a discipline can have several practical benefits. They can (1) be employed as tools to scaffold expert behavior among novices, (2) be translated into processes to make challenging tasks more efficient, and (3) provide deeper insights into the nature of a domain, task, or discipline. While the study of heuristics remains robust across domains, they have demonstrated differences in format and have been identified through a variety of data types. The purpose of this study is to unpack differences in heuristics independently identified through different data types in order to better understand the role these types of data can play in understanding of heuristics for course design, especially as related to engineering courses. We utilized thematic analysis to explore the patterns of differences between heuristics identified from the three settings in three related, but distinct studies. Datasets includes audio-recordings from a four-month team course redesign process, five approximately hour-long educator interviews, and 183 peer-reviewed course design papers. We identified four themes representing differences across the datasets: (1) differences in volume/frequency of heuristics, (2) differences in breadth, specificity, and conceptualizations evidenced by categories of heuristics, (3) individual heuristic specificity, and (4) locus of clarity in heuristic examples. These results inform a set of four considerations for selecting data sources for studies of heuristics within engineering course design and other domains.
more »
« less
How Engineering Educators Use Heuristics When Redesigning an Undergraduate Embedded Systems Course
Heuristics are cognitive strategies used to efficiently achieve an outcome and are used in the daily practice of many disciplines. Understanding the heuristics used by experts can help researchers and practitioners to better understand an activity and develop systems to support the efficacy and development of novices. While heuristics have been well-documented in psychology, industrial design, and engineering disciplines, they are not as thoroughly understood in the field of instructional design, or engineering course design in particular. This study sought to address that gap by using thematic analysis to identify and group the heuristics used by nine educators redesigning a second-year embedded systems course for electrical, computer, and software engineering students. We collected a variety of data, including audio recordings and written notes from team meetings, design artifacts (including final course materials), interviews with team members, and semi-weekly reflections from the course instructor, to explore heuristics from multiple lenses. We identified 22 heuristics, which were further grouped into 6 categories. The paper describes these heuristics and provides concrete examples of how they were used in practice. These findings indicate the prevalence of heuristics for engineering course design and suggests that additional heuristics can be identified across different educational settings.
more »
« less
- Award ID(s):
- 1623125
- PAR ID:
- 10337973
- Date Published:
- Journal Name:
- 2018 ASEE Annual Conference
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract BackgroundEngineering education traditionally emphasizes technical skills, sometimes at the cost of under‐preparing graduates for the real‐world engineering context. In recent decades, attempts to address this issue include increasing project‐based assignments and engineering design courses in curricula; however, a skills gap between education and industry remains. Purpose/HypothesisThis study aims to understand how undergraduate engineering students perceive product design before and after an upper‐level project‐based design course, as measured through concept maps. The purpose is to measure whether and how students account for the technical and nontechnical elements of design, as well as how a third‐year design course influences these design perceptions. Design/MethodConcept maps about product design were collected from 105 third‐year engineering students at the beginning and end of a design course. Each concept map's content and structure were quantitatively analyzed to evaluate the students' conceptual understandings and compare them across disciplines in the before and after conditions. ResultsThe analyses report on how student conceptions differ by discipline at the outset and how they changed after taking the course. Mechanical Engineering students showed a decrease in business‐related content and an increased focus on societal content, while students in the Engineering Management and Industrial and Systems Engineering programs showed an increase in business topics, specifically market‐related content. ConclusionThis study reveals how undergraduate students conceptualize product design, and specifically to what extent they consider engineering, business, and societal factors. The design courses were shown to significantly shape student conceptualizations of product design, and they did so in a way that mirrored the topics in the course syllabi. The findings offer insights into the education‐practice skills gap and may help future educators to better prepare engineering students to meet industry needs.more » « less
-
There have been many calls recently for computing for all across the nation. While there are many opportunities to study and use computing to advance the fields of computer science, software development, and information technology, computing is also needed in a wide range of other disciplines, including engineering. Most engineering programs require students take a course that teaches them introductory programming, which covers many of the same topics as an introductory course for computing majors (and at times may be the same course). However, statistics about the success of a course that is an introductory programming course are sobering; approximately half the students will fail, forcing them to either repeat the course or leave their chosen field of study if passing the course is required. This NSF IUSE project incorporates instructional techniques identified through educational psychology research as effective ways to improve student learning and retention in introductory programming. The research team has developed worked examples of problems that incorporate subgoal labels, which are explanations that describe the function of steps in the problem solution to the learner and highlight the problem-solving process. Using subgoal labels within worked examples, which has been effective in other STEM fields, students are able to see an expert's problem solving process, which helps students learn to solving problems before they can solve problem themselves. Experts, including instructors, teaching introductory level courses are often unable to explain the process they use in problem solving at a level that learners can grasp because they have automated much of the problem-solving processes after many years of practice. This submission will present the results of the first part of development of subgoals and will explain how to integrate them into classroom lessons in introductory computing classes.more » « less
-
Engineering is becoming increasingly cross-disciplinary, requiring students to develop skills in multiple engineering disciplines (e.g., mechanical engineering students having to learn the basics of electronics, instrumentation, and coding) and interprofessional skills to integrate perspectives from people outside their field. In the workplace, engineering teams are frequently multidisciplinary, and often, people from outside of engineering are part of the team that brings a product to market. Additionally, teams are often diverse in age, race, gender, and in other areas. Teams that creatively utilize the contrasting perspectives and ideas arising from these differences can positively affect team performance and generate solutions effective for a broader range of users. These trends suggest that engineering education can benefit from having engineering students work on team projects that involve a blend of cross-disciplinary and mixed-aged collaborations. An NSF-funded project set out to explore this idea by partnering undergraduate engineering students enrolled in a 300-level electromechanical systems course with preservice teachers enrolled in a 400-level educational technology course to plan and deliver robotics lessons to fifth graders at a local school. Working in small teams, students designed, built, and coded bio-inspired robots. The collaborative activities included: (1) training with Hummingbird Bit hardware (Birdbrain Technologies, Pittsburgh, PA) (e.g. sensors, servo motors) and coding platform, (2) preparing robotics lessons for fifth graders that explained the engineering design process, and (3) guiding the fifth graders in the design of their robots. Additionally, each engineering student designed a robot following the theme developed with their education student and fifth-grade partners.more » « less
-
Education literature has long emphasized the compounding benefits of reflective practice. Although reflection has largely been used as a tool for developing writing skills, contemporary research has explored its contributions to other disciplines including professional occupations such as nursing, teaching and engineering. Reflective assignments encourage engineering students to think critically about the impact engineers can and should have in the global community and their future role in engineering. The Department of Electrical and Computer Engineering at a small liberal arts college adopted ePortfolios in a first-year design course to encourage students to reframe their experiences and cultivate their identities as engineers. Our recent work demonstrated that students who create ePortfolios cultivate habits of reflective thinking that continue in subsequent courses within our program’s design sequence. However, student ability to transfer reflective habits across domains has remained unclear and encouraging critical engagement beyond the focused scope of technical content within more traditional core engineering courses is often difficult. In this work, we analyze students’ ability to transfer habits of reflective thinking across domains from courses within a designfocused course sequence to technical content-focused courses within a degree program. Extending reflection into core courses in a curriculum is important for several reasons. First, it stimulates metacognition which enables students to transfer content to future courses. Second, it builds students’ ability to think critically about technical subject matter. And third, it contributes to the ongoing development of their identities as engineers. Particularly for students traditionally underrepresented in engineering, the ability to integrate prior experiences and interests into one’s evolving engineering identity may lead to better retention and sense of belonging in the profession. In the first-year design course, electrical and computer engineering students (N=28) at a liberal arts university completed an ePortfolio assignment to explore the discipline. Using a combination of inductive and deductive coding techniques, multiple members of our team coded student reports and checked for intercoder reliability. Previously, we found that students’ reflection dramatically improved in the second-year design course [1]. Drawing upon Hatton and Smith’s (1995) categorizations of reflective thinking [2], we observed that students were particularly proficient in Dialogic Reflection, or reflection that relates to their own histories, interests, and experiences. In this paper, we compare the quality of student reflections in the second-year design course with those in a second-year required technical course to discover if reflective capabilities have transferred into a technical domain. We discovered that students are able to transfer reflective thinking across different types of courses, including those emphasizing technical content, after a single ePortfolio activity. Furthermore, we identified a similar pattern of improvement most notably in Dialogic Reflection. This finding indicates that students are developing sustained habits of reflective thinking. As a result, we anticipate an increase in their ability to retain core engineering concepts throughout the curriculum. Our future plans are to expand ePortfolio usage to all design courses as well as somemore » « less
An official website of the United States government

