skip to main content


Title: A Tool for Informing Community-Engaged Projects
While research suggests that community-engaged projects can be particularly effective, such work is notoriously time consuming and not scalable. The learning curve for an organization seeking to start such work is steep. Additionally, it is important to evaluate to what extent work typified as community engaged work actually creates a participatory space of communitycentered perspectives regarding roles, interests, worldviews, actions and outcomes. To this end, we developed a formative assessment tool using previously identified domains [1]. This tool, created in partnership between a university and an outreach group affiliated with the Air Force, allows organizations to evaluate existing projects and explore ways to develop on a path towards true community-engagement. The outreach group in this case undertakes significant STEM education within New Mexico, but in the past, a majority of the work has been done “for” or “to” communities, rather than “with” communities. We share development and initial use of the tool. By using the tool, several members made aspects of their work more explicit. Specifically, members shared ways they sought ideas, feedback, and insight from teachers, and how this informed their ongoing work. While the initial use of the tool revealed some uncertainty about community engagement, it opened space to value and expand existing practices aligned to community engagement. With increased use of the tool, members came to see some of their existing practices that were already aligned to community-engagement as more valued, and the individuals who led such work were positioned as contributing expertise, rather than anecdotes. Ongoing use of the tool, paired with leadership support, is driving the organization to change how they view community roles.  more » « less
Award ID(s):
1751369
NSF-PAR ID:
10311739
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the ASEE 128th Annual Conference and Exhibition
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Open-ended tasks can be both beneficial and challenging to students learning to program. Such tasks allow students to be more creative and feel ownership over their work, but some students struggle with unstructured tasks and, without proper scaffolds, this can lead to negative learning experiences. Scratch is a widely used coding platform to teach computer science in classrooms and is designed to support learner creativity and expression. With its open-ended nature, Scratch can be used in various ways in the classroom to meet the needs of schools and districts. One challenge of using Scratch in classrooms is supporting learners in exploring their interests and fostering creativity while still meeting the instructional goals of a lesson and ensuring all students are engaged with, and understand, focal concepts and practices. In this paper, we investigate the use of planning sheets to fa- cilitate novice programmers designing and implementing Scratch programs based on open-ended prompts. To evaluate the plan- ning sheets, we look at how closely students’ implemented Scratch projects match their plans and whether the implemented Scratch projects met the technical requirements for the given lesson. We analyzed 303 Scratch projects from 155 middle grade students (ages 10-14) who were introduced to programming via the Scratch Encore Curriculum. Completed Scratch projects that used planning sheets (202) were qualitatively coded to evaluate how closely they matched the initial plan, and Scratch programs (303) were analyzed with an automated grader to check if technical project requirements were met. Our results reveal that students that used planning sheets met significantly more technical project requirements and had more complex structures than those that did not have planning sheets. Results differ based on teacher and type of planning sheet used (physical vs. virtual). This work suggests that planning sheets are a helpful tool for young learners when completing open-ended coding projects. 
    more » « less
  2. null (Ed.)
    The proposed Biology Integration Institute will bring together two major research institutions in the Upper Midwest—the University of Minnesota (UMN) and University of Wisconsin-Madison (UW)—to investigate the causes and consequences of plant biodiversity across scales in a rapidly changing world —from genes and molecules within cells and tissues to communities, ecosystems, landscapes and the biosphere. The Institute focuses on plant biodiversity, defined broadly to encompass the heterogeneity within life that occurs from the smallest to the largest biological scales. A premise of the Institute is that life is envisioned as occurring at different scales nested within several contrasting conceptions of biological hierarchies, defined by the separate but related fields of physiology, evolutionary biology and ecology. The Institute will emphasize the use of ‘spectral biology’—detection of biological properties based on the interaction of light energy with matter—and process-oriented predictive models to investigate the processes by which biological components at one scale give rise to emergent properties at higher scales. Through an iterative process that harnesses cutting edge technologies to observe a suite of carefully designed empirical systems—including the National Ecological Observatory Network (NEON) and some of the world’s longest running and state-of-the-art global change experiments—the Institute will advance biological understanding and theory of the causes and consequences of changes in biodiversity and at the interface of plant physiology, ecology and evolution. INTELLECTUAL MERIT The Institute brings together a diverse, gender-balanced and highly productive team with significant leadership experience that spans biological disciplines and career stages and is poised to integrate biology in new ways. Together, the team will harness the potential of spectral biology, experiments, observations and synthetic modeling in a manner never before possible to transform understanding of how variation within and among biological scales drives plant and ecosystem responses to global change over diurnal, seasonal and millennial time scales. In doing so, it will use and advance state-of-the-art theory. The institute team posits that the designed projects will unearth transformative understanding and biological rules at each of the various scales that will enable an unprecedented capacity to discern the linkages between physiological, ecological and evolutionary processes in relation to the multi-dimensional nature of biodiversity in this time of massive planetary change. A strength of the proposed Institute is that it leverages prior federal investments in research and formalizes partnerships with foreign institutions heavily invested in related biodiversity research. Most of the planned projects leverage existing research initiatives, infrastructure, working groups, experiments, training programs, and public outreach infrastructure, all of which are already highly synergistic and collaborative, and will bring together members of the overall research and training team. BROADER IMPACTS A central goal of the proposed Institute is to train the next generation of diverse integrative biologists. Post-doctoral, graduate student and undergraduate trainees, recruited from non-traditional and underrepresented groups, including through formal engagement with Native American communities, will receive a range of mentoring and training opportunities. Annual summer training workshops will be offered at UMN and UW as well as training experiences with the Global Change and Biodiversity Research Priority Program (URPP-GCB) at the University of Zurich (UZH) and through the Canadian Airborne Biodiversity Observatory (CABO). The Institute will engage diverse K-12 audiences, the general public and Native American communities through Market Science modules, Minute Earth videos, a museum exhibit and public engagement and educational activities through the Bell Museum of Natural History, the Cedar Creek Ecosystem Science Reserve (CCESR) and the Wisconsin Tribal Conservation Association. 
    more » « less
  3. null (Ed.)
    In 2016, 10 universities launched a Networked Improvement Community (NIC) aimed at increasing the number of scholars from Alliances for Graduate Education and the Professoriate (AGEP) populations entering science, technology, engineering, and mathematics (STEM) faculty careers. NICs bring together stakeholders focused on a common goal to accelerate innovation through structured, ongoing intervention development, implementation, and refinement. We theorized a NIC organizational structure would aid understandings of a complex problem in different contexts and accelerate opportunities to develop and improve interventions to address the problem. A distinctive feature of this NIC is its diverse institutional composition of public and private, predominantly white institutions, a historically Black university, a Hispanic-serving institution, and land grant institutions located across eight states and Washington, DC, United States. NIC members hold different positions within their institutions and have access to varied levers of change. Among the many lessons learned through this community case study, analyzing and addressing failed strategies is as equally important to a healthy NIC as is sharing learning from successful interventions. We initially relied on pre-existing relationships and assumptions about how we would work together, rather than making explicit how the NIC would develop, establish norms, understand common processes, and manage changing relationships. We had varied understandings of the depth of campus differences, sometimes resulting in frustrations about the disparate progress on goals. NIC structures require significant engagement with the group, often more intensive than traditional multi-institution organizational structures. They require time to develop and ongoing maintenance in order to advance the work. We continue to reevaluate our model for leadership, climate, diversity, conflict resolution, engagement, decision-making, roles, and data, leading to increased investment in the success of all NIC institutions. Our NIC has evolved from the traditional NIC model to become the Center for the Integration of Research, Teaching and Learning (CIRTL) AGEP NIC model with five key characteristics: (1) A well-specified aim, (2) An understanding of systems, including a variety of contexts and different organizations, (3) A culture and practice of shared leadership and inclusivity, (4) The use of data reflecting different institutional contexts, and (5) The ability to accelerate infrastructure and interventions. We conclude with recommendations for those considering developing a NIC to promote diversity, equity, and inclusion efforts. 
    more » « less
  4. In this work-in-progress paper, we continue investigation into the propagation of the Concept Warehouse within mechanical engineering (Friedrichsen et al., 2017; Koretsky et al., 2019a). Even before the pandemic forced most instruction online, educational technology was a growing element in classroom culture (Koretsky & Magana, 2019b). However, adoption of technology tools for widespread use is often conceived from a turn-key lens, with professional development focused on procedural competencies and fidelity of implementation as the goal (Mills & Ragan, 2000; O’Donnell, 2008). Educators are given the tool with initial operating instructions, then left on their own to implement it in particular instructional contexts. There is little emphasis on the inevitable instructional decisions around incorporating the tool (Hodge, 2019) or on sustainable incorporation of technologies into existing instructional practice (Forkosh-Baruch et al., 2021). We consider the take-up of a technology tool as an emergent, rather than a prescribed process (Henderson et al., 2011). In this WIP paper, we examine how two instructors who we call Al and Joe reason through their adoption of a technology tool, focusing on interactions among instructors, tool, and students within and across contexts. The Concept Warehouse (CW) is a widely-available, web-based, open educational technology tool used to facilitate concept-based active learning in different contexts (Friedrichsen et al., 2017; Koretsky et al., 2014). Development of the CW is ongoing and collaboration-driven, where user-instructors from different institutions and disciplines can develop conceptual questions (called ConcepTests) and other learning and assessment tools that can be shared with other users. Currently there are around 3,500 ConcepTests, 1,500 faculty users, and 36,000 student users. About 700 ConcepTests have been developed for mechanics (statics and dynamics). The tool’s spectrum of affordances allows different entry points for instructor engagement, but also allows their use to grow and change as they become familiar with the tool and take up ideas from the contexts around them. Part of a larger study of propagation and use across five diverse institutions (Nolen & Koretsky, 2020), instructors were introduced to the tool, offered an introductory workshop and opportunity to participate in a community of practice (CoP), then interviewed early and later in their adoption. For this paper, we explore a bounded case study of the two instructors, Al and Joe, who took up the CW to teach Introductory Statics. Al and Joe were experienced instructors, committed to active learning, who presented examples from their ongoing adaptation of the tool for discussion in the community of practice. However, their decisions about how to integrate the tool fundamentally differed, including the aspects of the tool they took up and the ways they made sense of their use. In analyzing these two cases, we begin to uncover how these instructors navigated the dynamic nature of pedagogical decision making in and across contexts. 
    more » « less
  5. Objectives We examine the community epistemologies in youth’s iterative refinements of STEM-rich inventions across settings and time. Iteration in STEM-rich engineering/invention work refers to re-thinking ideas/designs within prototyping processes (Cunningham & Kelly, 2017). The objective of this paper is to examine the political dimensions of iteration through a) how iteration involves pre- and post-design “lives” of inventions especially towards new social futures, and b) the intentional incorporation of cultural epistemologies towards advancing new forms of legitimate inventor knowledge/practice (Yosso, 2005). Framing We draw from critical justice and consequential learning studies. Critical justice focuses on recognizing diversity and addressing structural inequalities perpetuated through systemic racism and classism. It seeks re-shifted relations of power and position within multiple scales-of-activity in learning, intersected with historicized injustices in learning environments. Consequential learning examines what matters to people, and how associated values and practices, when coordinated through social activity, allows for imagining new social futures (Gutierrez, 2012). Viewing the iterative process of inventing through a justice-oriented consequential lens calls into question traditional modes of knowing, and challenges/expands who and what areas of expertise are recognized and valued. Methods Our study takes place in two community makerspaces in mid-sized cities. Both center community engagement and support youth in designing/inventing to address problems they and their communities care about. Both also support minoritized youth in inventing through engagement with a wide range of community/STEM stakeholders. In researcher-educator roles, we collaborated with both makerspaces to establish programs supporting youth in sustained engagement in STEM and making/inventing in culturally-sustaining ways. In our two-year, longitudinal critical ethnography, data were generated in weekly community making sessions between 2016-2018. Data include artifacts, youth conversation groups, and videos capturing youth interaction with STEM and community experts at various stages in their design process. Analysis involved multiple stages and levels of coding based on open-coding and constant comparison procedures. Findings We ground our paper in four in-depth longitudinal cases of youth’s iterative design work: Nila’s light-up #stopracism sign; Su’zanne’s massaging slipper, Sharon’s geodesic play dome, and Jazmyn’s portable fan. Across cases, we illustrate three findings. First, youth located broader injustices within local making/inventing discourses with support from community and STEM allies, suggesting youth drew from multiple epistemologies, some grounded in community cultural wealth, others in STEM. For example, Su’Zanne drew from a familial culture of care and resistance in recognizing injustices nested in homelessness while iterating a way to make her slipper “more massaging.” The geodesic dome youth-makers drew from collective solidarity/resistance in making a structure for younger peers due to unjust lack of play infrastructure. Second, iterative engagement involving community wealth afforded further design and inventing experiences and expanded ownership over inventions across many stakeholders. For example, youth turned Nila’s #stopracism sign on during group discussions when they felt that racism needed to be foregrounded. Third, the afterlife of youth invention processes impacted the emergent inventor-maker culture through influencing the iterative process. Significance Iterations expand hybridization of cultural knowledge/practice and STEM-rich inventing, re-shaping whose cultural knowledge matters, and fostering justice-oriented collective outcomes. 
    more » « less