skip to main content


Title: Preparing, Visualizing, and Using Real-world Data in Introductory Courses
In recent years, interactive textbooks have gained prominence in an effort to overcome student reluctance to routinely read textbooks, complete assigned homeworks, and to better engage students to keep up with lecture content. Interactive textbooks are more structured, contain smaller amounts of textual material, and integrate media and assessment content. While these are an arguable improvement over traditional methods of teaching, issues of academic integrity and engagement remain. In this work we demonstrate preliminary work on building interactive teaching modules for data structures and algorithms courses with the following characteristics, (1) the modules are highly visual and interactive, (2) training and assessment are tightly integrated within the same module, with sufficient variability in the exercises to make it next to impossible to violate academic integrity, (3) a data logging and analytic system that provides instantaneous student feedback and assessment, and (4) an interactive visual analytic system for the instructor to see students’ performance at the individual, sub-group or class level, allowing timely intervention and support for selected students. Our modules are designed to work within the infrastructure of the OpenDSA system, which will promote rapid dissemination to an existing user base of CS educators. We demonstrate a prototype system using an example dataset.  more » « less
Award ID(s):
1726809 1245841
NSF-PAR ID:
10064382
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
ACM Special Interest Group on Computer Science Education 2018
Page Range / eLocation ID:
676 to 677
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The development of tools that promote active learning in engineering disciplines is critical. It is widely understood that students engaged in active learning environments outperform those taught using passive methods. Previously, we reported on the development and implementation of hands-on Low-Cost Desktop Learning Modules (LCDLMs) that replicate real-world industrial equipment which serves to create active learning environments. Thus far, miniaturized venturi meter, hydraulic loss, and double-pipe and shell & tube heat exchanger DLMs have been utilized by hundreds of students across the country. It was demonstrated that the use of DLMs in face-to-face classrooms results in statistically significant improvements in student performance as well as increases in student motivation compared to students taught in a traditional lecture-only style classroom. Last year, participants in the project conducted 45 implementations including over 600 DLMs at 24 universities across the country reaching more than 1,000 students. In this project, we report on the significant progress made in broad dissemination of DLMs and accompanying pedagogy. We demonstrate that DLMs serve to increase student learning gains not only in face-toface environments but also in virtual learning environments. Instructional videos were developed to aid in DLM-based learning during the COVID-19 pandemic when instructors were limited to virtual instruction. Preliminary results from this work show that students working with DLMs even in a virtual setting significantly outperform those taught without DLM-associated materials. Significant progress has also been made on the development of a new DLM cartridge: a see-through 3Dprinted miniature fluidized bed. The new 3D printing methodology will allow for rapid prototyping and streamlined development of DLMs. A 3D-printed evaporative cooling tower DLM will also be developed in the coming year. In October 2020, the team held a virtual implementers workshop to train new participating faculty in DLM use and implementation. In total, 13 new faculty participants from 10 universities attended the 6-hour, 2- day workshop and plan to implement DLMs in their classrooms during this academic year. In the last year, this project was disseminated in 8 presentations at the ASEE Virtual Conference (June 2020) and American Institute of Chemical Engineers Annual Conference (November 2019) as well as the AIChE virtual Community of Practice Labs Group and a seminar at a major university, ultimately disseminating DLM pedagogy to approximately 200 individuals including approximately 120 university faculty. Further, the former group postdoc has accepted an instructor faculty position at University of Wisconsin Madison where she will teach unit operations among other subjects; she and the remainder of the team believe the LCDLM project has prepared her well for that position. In the remaining 2.5 years of the project, we will continue to evaluate the effectiveness of DLMs in teaching key heat transfer and fluid dynamics concepts thru implementations in the rapidly expanding pool of participating universities. Further, we continue our ongoing efforts in creating the robust support structure necessary for large-scale adoption of hands-on educational tools for promotion of hands-on interactive student learning. 
    more » « less
  2. null (Ed.)
    The development of tools that promote active learning in engineering disciplines is critical. It is widely understood that students engaged in active learning environments outperform those taught using passive methods. Previously, we reported on the development and implementation of hands-on Low-Cost Desktop Learning Modules (LCDLMs) that replicate real-world industrial equipment which serves to create active learning environments. Thus far, miniaturized venturi meter, hydraulic loss, and double-pipe and shell & tube heat exchanger DLMs have been utilized by hundreds of students across the country. It was demonstrated that the use of DLMs in face-to-face classrooms results in statistically significant improvements in student performance as well as increases in student motivation compared to students taught in a traditional lecture-only style classroom. Last year, participants in the project conducted 45 implementations including over 600 DLMs at 24 universities across the country reaching more than 1,000 students. In this project, we report on the significant progress made in broad dissemination of DLMs and accompanying pedagogy. We demonstrate that DLMs serve to increase student learning gains not only in face-to-face environments but also in virtual learning environments. Instructional videos were developed to aid in DLM-based learning during the COVID-19 pandemic when instructors were limited to virtual instruction. Preliminary results from this work show that students working with DLMs even in a virtual setting significantly outperform those taught without DLM-associated materials. Significant progress has also been made on the development of a new DLM cartridge: a see-through 3D-printed miniature fluidized bed. The new 3D printing methodology will allow for rapid prototyping and streamlined development of DLMs. A 3D-printed evaporative cooling tower DLM will also be developed in the coming year. In October 2020, the team held a virtual implementers workshop to train new participating faculty in DLM use and implementation. In total, 13 new faculty participants from 10 universities attended the 6-hour, 2-day workshop and plan to implement DLMs in their classrooms during this academic year. In the last year, this project was disseminated in 8 presentations at the American Society for Engineering Education (ASEE) Virtual Conference (June 2020) and American Institute of Chemical Engineers Annual Conference (November 2019) as well as the AIChE virtual Community of Practice Labs Group and a seminar at a major university, ultimately disseminating DLM pedagogy to approximately 200 individuals including approximately 120 university faculty. Further, the former group postdoc has accepted an instructor faculty position at University of Wisconsin Madison where she will teach unit operations among other subjects; she and the remainder of the team believe the LCDLM project has prepared her well for that position. In the remaining 2.5 years of the project, we will continue to evaluate the effectiveness of DLMs in teaching key heat transfer and fluid dynamics concepts thru implementations in the rapidly expanding pool of participating universities. Further, we continue our ongoing efforts in creating the robust support structure necessary for large-scale adoption of hands-on educational tools for promotion of hands-on interactive student learning. 
    more » « less
  3. Previous studies have convincingly shown that traditional, content-centered, and didactic teaching methods are not effective for developing a deep understanding and knowledge transfer. Nor does it adequately address the development of critical problem-solving skills. Active and collaborative instruction, coupled with effective means to encourage student engagement, invariably leads to better student learning outcomes irrespective of academic discipline. Despite these findings, the existing construction engineering programs, for the most part, consist of a series of fragmented courses that mainly focus on procedural skills rather than on the fundamental and conceptual knowledge that helps students become innovative problem-solvers. In addition, these courses are heavily dependent on traditional lecture-based teaching methods focused on well-structured and closed-ended problems that prepare students to plug variables into equations to get the answer. Existing programs rarely offer a systematic approach to allow students to develop a deep understanding of the engineering core concepts and discover systematic solutions for fundamental problems. Without properly understanding these core concepts, contextualized in domain-specific settings, students are not able to develop a holistic view that will help them to recognize the big picture and think outside the box to come up with creative solutions for arising problems. The long history of empirical learning in the field of construction engineering shows the significant potential of cognitive development through direct experience and reflection on what works in particular situations. Of course, the complex nature of the construction industry in the twenty-first century cannot afford an education through trial and error in the real environment. However, recent advances in computer science can help educators develop virtual environments and gamification platforms that allow students to explore various scenarios and learn from their experiences. This study aims to address this need by assessing the effectiveness of guided active exploration in a digital game environment on students’ ability to discover systematic solutions for fundamental problems in construction engineering. To address this objective, through a research project funded by the NSF Division of Engineering Education and Centers (EEC), we designed and developed a scenario-based interactive digital game, called Zebel, to guide students solve fundamental problems in construction scheduling. The proposed gamified pedagogical approach was designed based on the Constructivism learning theory and a framework that consists of six essential elements: (1) modeling; (2) reflection; (3) strategy formation; (4) scaffolded exploration; (5) debriefing; and (6) articulation. We also designed a series of pre- and post-assessment instruments for empirical data collection to assess the effectiveness of the proposed approach. The proposed gamified method was implemented in a graduate-level construction planning and scheduling course. The outcomes indicated that students with no prior knowledge of construction scheduling methods were able to discover systematic solutions for fundamental scheduling problems through their experience with the proposed gamified learning method. 
    more » « less
  4. null (Ed.)
    As technology advances, data driven work is becoming increasingly important across all disciplines. Data science is an emerging field that encompasses a large array of topics including data collection, data preprocessing, data visualization, and data analysis using statistical and machine learning methods. As undergraduates enter the workforce in the future, they will need to “benefit from a fundamental awareness of and competence in data science”[9]. This project has formed a research practice partnership that brings together STEM+C instructors and researchers from three universities and an education research and consulting group. We aim to use high frequency monitoring data collected from real-world systems to develop and implement an interdisciplinary approach to enable undergraduate students to develop an understanding of data science concepts through individual STEM disciplines that include engineering, computer science, environmental science, and biology. In this paper, we perform an initial exploratory analysis on how data science topics are introduced into the different courses, with the ultimate goal of understanding how instructional modules and accompanying assessments can be developed for multidisciplinary use. We analyze information collected from instructor interviews and surveys, student surveys, and assessments from five undergraduate courses (243 students) at the three universities to understand aspects of data science curricula that are common across disciplines. Using a qualitative approach, we find commonalities in data science instruction and assessment components across the disciplines. This includes topical content, data sources, pedagogical approaches, and assessment design. Preliminary analyses of instructor interviews also suggest factors that affect the content taught and the assessment material across the five courses. These factors include class size, students’ year of study, students’ reasons for taking class, and students’ background expertise and knowledge. These findings indicate the challenges in developing data modules for multidisciplinary use. We hope that the analysis and reflections on our initial offerings has improved our understanding of these challenges, and how we may address them when designing future data science teaching modules. These are the first steps in a design-based approach to developing data science modules that may be offered across multiple courses. 
    more » « less
  5. null (Ed.)
    As technology advances, data driven work is becoming increasingly important across all disciplines. Data science is an emerging field that encompasses a large array of topics including data collection, data preprocessing, data visualization, and data analysis using statistical and machine learning methods. As undergraduates enter the workforce in the future, they will need to “benefit from a fundamental awareness of and competence in data science”[9]. This project has formed a research practice partnership that brings together STEM+C instructors and researchers from three universities and an education research and consulting group. We aim to use high frequency monitoring data collected from real-world systems to develop and implement an interdisciplinary approach to enable undergraduate students to develop an understanding of data science concepts through individual STEM disciplines that include engineering, computer science, environmental science, and biology. In this paper, we perform an initial exploratory analysis on how data science topics are introduced into the different courses, with the ultimate goal of understanding how instructional modules and accompanying assessments can be developed for multidisciplinary use. We analyze information collected from instructor interviews and surveys, student surveys, and assessments from five undergraduate courses (243 students) at the three universities to understand aspects of data science curricula that are common across disciplines. Using a qualitative approach, we find commonalities in data science instruction and assessment components across the disciplines. This includes topical content, data sources, pedagogical approaches, and assessment design. Preliminary analyses of instructor interviews also suggest factors that affect the content taught and the assessment material across the five courses. These factors include class size, students’ year of study, students’ reasons for taking class, and students’ background expertise and knowledge. These findings indicate the challenges in developing data modules for multidisciplinary use. We hope that the analysis and reflections on our initial offerings has improved our understanding of these challenges, and how we may address them when designing future data science teaching modules. These are the first steps in a design-based approach to developing data science modules that may be offered across multiple courses. 
    more » « less