When college campuses resumed in-person learning opportunities following initial lockdowns during the COVID-19 pandemic, many facets of campus life looked different. These differences continue to evolve from semester to semester because of changing health guidelines, school decisions, and personal convictions. Academic makerspaces were not exempt from these changes and have experienced fluctuating usage and usage barriers over the past several semesters. Better understanding the effects of COVID-19 on academic makerspaces can help ensure that students continue to draw maximum benefits from these learning spaces and also provides potential advice for administrators and educators for future disturbances. Data collected via tool usage surveys administered to makerspace users at a large public university during the three semesters following the start of the pandemic (Fall 2020, Spring 2021, and Spring 2022) is used here to investigate. COVID-19 restrictions present during Fall 2020 and Spring 2021 were mostly loosened in Spring 2022. The makerspace is modeled as a bipartite network, with student and tool interactions determined via end-of-semester surveys. The network is analyzed using nestedness, a metric primarily used in ecology to evaluate the stability of an ecosystem and proposed here as a quantitative method to evaluate makerspace health. The surveys used to create the network models also provide validation, as students were asked to share tools used during the semester in question. The results suggest that nestedness is linearly proportional to usage, both increases and decreases. As such, tracking the nestedness of a makespace over time can serve as a warning that unintended restrictions are in place, intentional restrictions and/or policies may be too severe, or whether a space has effectively recovered from temporary restrictions.
more »
« less
Bipartite Network Analysis Utilizing Survey Data to Determine Student and Tool Interactions in a Makerspace
There has been dramatic growth in the number of makerspaces at educational institutions. More research is needed to understand student interactions in these spaces and how these spaces should be designed to support student learning. This project uses network analysis techniques to study the network of activities in a makerspace that lead to successful student experiences. The proposed analyses will model a makerspace as a network of interactions between equipment, staff, and students. Results from this study will help educators to 1) identify and remove previously unknown hurdles for students who rarely use the space, 2) design an effective space using limited resources, 3) understand the impact of new equipment or staff, and 4) create learning opportunities such as workshops and curriculum integration that increase student learning. The new knowledge produced by this project may be useful for maximizing equipment and support infrastructure, and for guiding new equipment purchases. Thus, the results will support further development of effective makerspaces.
This project hypothesizes that network-level analyses and metrics can provide valuable insights into student learning in makerspaces and will support what-if scenarios for proposed changes in spaces. Systems modeling and analysis have been used successfully to understand complex human and biological networks. In the context of makerspaces, this technique will provide measures of interaction between system components such as students, staff, and equipment. The analyses will identify the system components that are frequently used when students work in the makerspace over multiple visits. The project will allow for the comparison of makerspaces that have different levels of integration with the curriculum and methods of student introduction (pop-up classes, tours, extra-curricular competitions, advertising, and bring a friend). Demonstration of the effectiveness of the analyses in characterizing makerspaces and the ease of data collection will help support the use of this approach in future work that compares makerspaces nationwide. Current results explore the order in which students choose to learn and use the tools in the space, which tools/features are used most frequently and how the data from the daily entry/exit surveys compares to the end-of-semester self-reports. A key question in this research, especially for making it adoptable by other universities, is if end-of-semester, self-reported data is accurate enough to create informative, actionable guidance from the network models without requiring the daily tool usage data.
more »
« less
- NSF-PAR ID:
- 10331810
- Date Published:
- Journal Name:
- 2021 ASEE Virtual Annual Conference
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Academic makerspaces have continued to rise in popularity as research shows the diverse benefits they provide to students. More and more engineering curriculums are incorporating makerspaces and as such there is a need to better understand how their student users can best be served. Surveys administered to makerspace users at a public research university in the Southwest United States during Fall 2020, Spring 2021, Spring 2022, and Fall 2022 tracked student tool usage trends with academic career stages. The survey asked questions about prior experience, motivation, tool usage, and demographics. Analyzed results for mechanical engineering student users provide insight into how curriculum and class year affect the specific tools used and the percentage of students who used a particular tool. The survey results also create a bipartite network model of students and tools, mimicking plant-pollinator type mutualistic networks in ecology. The bipartite network models the student interactions with the tools and visualizes how students interact with the tools. This network modeling enables ecological network analysis techniques to identify key makerspace actors quantitatively. Ecological modularity, for example, identifies divisions in the student-tool makerspace network that highlight how students from different majors (here we investigate mechanical) utilize the makerspace's tools. Modularity is also able to identify “hub” tools in the space, defined as tools central to a student's interaction within the space, based on student-tool connectivity data. The analysis finds that tools commonly used for class by mechanical engineering students, such as the 3D printer or laser cutter, act as gateway tools that bring users into the space and help spark interest in the space's other tools. Using the combined insights from the survey results and the network analysis, ecological network metrics are shown here to be a promising route for informing makerspace policy, tool purchases, and curriculum development. The results can help ensure that the space is set up to give students the best learning opportunities.more » « less
-
Globally, universities have heavily invested in makerspaces. Purposeful investment however requires an understanding of how students use tools and how tools aid in engineering education. This paper utilizes a modularity analysis in combination with student surveys to analyze and understand the space as a network of student-tool interactions. The results show that a modularity analysis is able to identify the roles of different tool groupings in the space by measuring how well tool groups are connected within their own “module” and their connection to tools outside of their module. A highly connected tool in both categories is considered a hub that is critical to the network. Poorly connected tools indicate insignificance or under utilization. Makerspaces at two universities were investigated: School A with a full-time staff running the makerspace and School B run by student-volunteers. The results show that 3D printers and metal tools are hubs at School A and 3D printers, metal tools, and laser cutters are hubs at School B. School B was also found to have a higher overall interaction with all the tools in the space. The modularity analysis results are validated using two-semesters worth of student self-reported survey data. The results support the use of a modularity analysis as a way to analyze and visualize the complex network interactions occurring within a makerspace, which can support the improvement of current makerspaces and development of future makerspaces.more » « less
-
Globally, universities have heavily invested in makerspaces. Purposeful investment however requires an understanding of how students use tools and how tools aid in engineering education. This paper utilizes a modularity analysis in combination with student surveys to analyze and understand the space as a network of student-tool interactions. The results show that a modularity analysis is able to identify the roles of different tool groupings in the space by measuring how well tool groups are connected within their own “module” and their connection to tools outside of their module. A highly connected tool in both categories is considered a hub that is critical to the network. Poorly connected tools indicate insignificance or under utilization. Makerspaces at two universities were investigated: School A with a full-time staff running the makerspace and School B run by student-volunteers. The results show that 3D printers and metal tools are hubs at School A and 3D printers, metal tools, and laser cutters are hubs at School B. School B was also found to have a higher overall interaction with all the tools in the space. The modularity analysis results are validated using two-semesters worth of student self-reported survey data. The results support the use of a modularity analysis as a way to analyze and visualize the complex network interactions occurring within a makerspace, which can support the improvement of current makerspaces and development of future makerspaces.more » « less
-
Clifford Whitcomb (Ed.)Analyzing interactions between actors from a systems perspective yields valuable information about the overall system's form and function. When this is coupled with ecological modeling and analysis techniques, biological inspiration can also be applied to these systems. The diagnostic value of three metrics frequently used to study mutualistic biological ecosystems (nestedness, modularity, and connectance) is shown here using academic engineering makerspaces. Engineering students get hands‐on usage experience with tools for personal, class, and competition‐based projects in these spaces. COVID‐19 provides a unique study of university makerspaces, enabling the analysis of makerspace health through the known disturbance and resultant regulatory changes (implementation and return to normal operations). Nestedness, modularity, and connectance are shown to provide information on space functioning in a way that enables them to serve as heuristic diagnostics tools for system conditions. The makerspaces at two large R1 universities are analyzed across multiple semesters by modeling them as bipartite student‐tool interaction networks. The results visualize the predictive ability of these metrics, finding that the makerspaces tended to be structurally nested in any one semester, however when compared to a “normal” semester the restrictions are reflected via a higher modularity. The makerspace network case studies provide insight into the use and value of quantitative ecosystem structure and function indicators for monitoring similar human‐engineered interaction networks that are normally only tracked qualitatively.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.18260/1-2--36750
