skip to main content


Title: Analyzing K-12 Education as a Complex System
Schools and school districts are complex, dynamic systems affected by numerous factors, specific to the particular environment. These factors, which range from the stability of the home life of the enrolled children, to the interpersonal relationships of the school staff, to the funding decisions of the school board, to the laws passed by the U.S. Congress (and innumerable additional factors in between), all interact in sometimes predictable but often completely surprising ways. Educational initiatives and interventions that work well in one environment can prove completely ineffective (or un-implementable) in a different school setting, for a myriad of reasons. For university faculty and STEM professionals who partner with K-12 schools to implement and assess STEM educational reform initiatives, particularly for those who choose to work or scale up projects in non-charter or non-specialized lab school settings, the complexity of the system of K-12 education makes it difficult to identify all the potential barriers that can impact the proposed project. Unexpected factors can easily derail an otherwise well thought-out project, both in terms of project implementation and also in the success of assessing student outcomes. Educational researchers have long studied school reform and the issues of what facilitates and hinders success in curricular and other interventions. Experts in educational policy and public policy also have studied the interaction of policies and practices of reform agendas within social and organizational contexts. Industrial engineering, which had its origins in studying manufacturing systems, is a field where researchers have made great contributions towards understanding complex systems including transportation systems, financial systems, health care, and even recently humanitarian support systems. The Advanced Manufacturing and Prototyping Integrated to Unlock Potential (AMP-IT-UP) NSF Math/Science Partnership at the Georgia Institute of Technology is creating an innovative framework, which is both conceptual and theoretical and rooted within the field of industrial and systems engineering, to examine barriers and enablers to school change and reform. The framework describes the system in terms of both agents and the attributes of those agents and will become the foundation for identifying a subset of attribute combinations that allow for successful change in the system. In this paper we describe the first step in creating this framework, namely identifying the agents within K-12 education and the attributes of these agents that are critical to educational change. The paper also presents a sample scale for describing these attributes.  more » « less
Award ID(s):
1238089
NSF-PAR ID:
10058532
Author(s) / Creator(s):
Date Published:
Journal Name:
ASEE annual conference & exposition
ISSN:
2153-5965
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Despite limited success in broadening participation in engineering with rural and Appalachian youth, there remain challenges such as misunderstandings around engineering careers, misalignments with youth’s sociocultural background, and other environmental barriers. In addition, middle school science teachers may be unfamiliar with engineering or how to integrate engineering concepts into science lessons. Furthermore, teachers interested in incorporating engineering into their curriculum may not have the time or resources to do so. The result may be single interventions such as a professional development workshop for teachers or a career day for students. However, those are unlikely to cause major change or sustained interest development. To address these challenges, we have undertaken our NSF ITEST project titled, Virginia Tech Partnering with Educators and Engineers in Rural Schools (VT PEERS). Through this project, we sought to improve youth awareness of and preparation for engineering related careers and educational pathways. Utilizing regular engagement in engineering-aligned classroom activities and culturally relevant programming, we sought to spark an interest with some students. In addition, our project involves a partnership with teachers, school districts, and local industry to provide a holistic and, hopefully, sustainable influence. By engaging over time we aspired to promote sustainability beyond this NSF project via increased teacher confidence with engineering related activities, continued integration within their science curriculum, and continued relationships with local industry. From the 2017-2020 school years the project has been in seven schools across three rural counties. Each year a grade level was added; that is, the teachers and students from the first year remained for all three years. Year 1 included eight 6th grade science teachers, year 2 added eight 7th grade science teachers, and year 3 added three 8th grade science teachers and a career and technology teacher. The number of students increased from over 500 students in year 1 to over 2500 in year 3. Our three industry partners have remained active throughout the project. During the third and final year in the classrooms, we focused on the sustainable aspects of the project. In particular, on how the intervention support has evolved each year based on data, support requests from the school divisions, and in scaffolding “ownership” of the engineering activities. Qualitative data were used to support our understanding of teachers’ confidence to incorporate engineering into their lessons plans and how their confidence changed over time. Noteworthy, our student data analysis resulted in an instrument change for the third year; however due to COVID, pre and post data was limited to schools who taught on a semester basis. Throughout the project we have utilized the ITEST STEM Workforce Education Helix model to support a pragmatic approach of our research informing our practice to enable an “iterative relationship between STEM content development and STEM career development activities… within the cultural context of schools, with teachers supported by professional development, and through programs supported by effective partnerships.” For example, over the course of the project, scaffolding from the University leading interventions to teachers leading interventions occurred. 
    more » « less
  2. This WIP presentation is intended to share and gather feedback on the development of an observation protocol for K-12 integrated STEM instruction, the STEM-OP. Specifically, the STEM-OP is being developed for use in K-12 science and/or engineering settings where integrated STEM instruction takes place. While the importance of integrated STEM education is established through national policy documents, there remains disagreement on models and effective approaches for integrated STEM instruction. Our broad definition of integrated STEM includes the use of two or more STEM disciplines to solve a real-world problem or design challenge that supports student development of 21st century skills. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning that can be used to inform research of the effectiveness of new models and strategies. Existing instruments most commonly used by researchers, such as the Reformed Teaching Observation Protocol (RTOP), were designed prior to the development of the Next Generation Science Standards and the integration of engineering into science standards. These instruments were also designed for use in reform-based science classrooms, not engineering or integrated STEM learning environments. While engineering-focused observation protocols do exist for K-12 classrooms, they do not evaluate beyond an engineering focus, making them limited tools to evaluate integrated STEM instruction. In order to facilitate the implementation of integrated STEM in K-12 classrooms and the development of the nascent integrated STEM education literature, our research team is developing a new integrated STEM observation protocol for use in K-12 science and engineering classrooms. This valid and reliable instrument will be designed for use in a variety of educational contexts and by different education stakeholders to increase the quality of K-12 STEM education. At the end of this project, the STEM-OP will be made available through an online platform that will include an embedded training program to facilitate its broad use. In the first year of this four-year project, we are working on the initial development of the STEM-OP through video analysis and exploratory factor analysis. We are utilizing existing classroom video from a previous project with approximately 2,000 unique classroom videos representing a variety of grade levels (4-9), science content (life, earth, and physical science), engineering design challenges, and school demographics (urban, suburban). The development of the STEM-OP is guided by published frameworks that focus on providing quality K-12 integrated STEM and engineering education, such as the Framework for Quality K-12 Engineering Education. Our anticipated results at the time the ASEE meeting will include a review of our item development process and finalized items included on the draft STEM-OP. Additionally, we anticipate being able to share findings from the exploratory factor analysis (EFA) on our video-coded data, which will identify distinct instructional dimensions responsible for integrated STEM instruction. We value the opportunity to gather feedback from the engineering education community as the integration of engineering design and practices is integral to quality integrated STEM instruction. 
    more » « less
  3. Student success in educational ecosystems is a primary goal of leadership efforts. Yet, power and privilege affect the racial, classist, and gendered implications of STEM education work in K-12 education as well as higher education. Interventions have been done at various levels, but despite the hard work of implementation, this has not resulted in dramatic improvements to STEM educational ecosystems or student engagement within them. Often, these implementations are done at the faculty/student level or institutional level but not at the departmental leadership level. The NSF-supported Eco-STEM Project proposes to establish a healthy educational ecosystem that supports all individuals (students, faculty, and staff) to thrive. Project activities are guided by ecosystem paradigm measures that support a culturally responsive learning/working environment; make teaching and learning rewarding and fulfilling; and emphasize community assets to enhance motivation, excellence, and success. For this work-in-progress paper, we describe the development of a leadership community of practice, comprised of department chairs of science and engineering departments, at [university name redacted], a large state-funded comprehensive majority minority master’s granting institution in the Southwest United States. In the year-long Leadership Community of Practice (L-CoP), the Fellows work on unpacking issues of power and privilege in their roles as STEM leaders and educators. During the Fall semester of 2022, the Fellows participated in four sessions. They engaged in readings, videos, active-learning activities, and critically reflective dialogues to facilitate discussion and reflection on identity, agency, the culture of power in STEM, and interventions and change in higher education. The L-CoP starts with Fellows reflecting on their social and professional identities and how their identities influence their teaching and leadership philosophies. Then Fellows are introduced to the framework of the culture of power in science--where they explore the social, cultural, and political impacts of preparing for a STEM college education. Finally, they explore theories and models of change for STEM higher education spaces. Through this curriculum, we aim to examine mental models to deconstruct notions that uphold the culture of power in science by instead building counternarratives with faculty and students in their departments. Through dialogues within the L-CoP, leaders discuss classroom/program climate, structure, and vibrancy to better support healthy educational ecosystems, as well as their participation in these systems. We are currently in the middle of our first implementation of the L-CoP. The first cohort consists of six L-CoP Fellows with highly diverse positionalities; there is racial, ethnic, and gender diversity, and all Fellows are full professors in the tenure line and chairs of their respective departments. We present details of the L-CoP, including the formation of the Fellow cohort, training of the facilitators, structure of the sessions, and initial results of our mid-program survey. The survey results provide insights into potential improvements to our tools and program. We also share some of the Fellows’ and facilitators’ reflections demonstrating a shift toward an ecosystem mindset. We prefer to present this work as a poster at the 2023 ASEE Annual Conference. 
    more » « less
  4. Abstract The CCERS partnership includes collaborators from universities, foundations, education departments, community organizations, and cultural institutions to build a new curriculum. As reported in a study conducted by the Rand Corporation (2011), partnerships among districts, community-based organizations, government agencies, local funders, and others can strengthen learning programs. The curriculum merged project-based learning and Bybee’s 5E model (Note 1) to teach core STEM-C concepts to urban middle school students through restoration science. CCERS has five interrelated and complementary programmatic pillars (see details in the next section). The CCERS curriculum encourages urban middle school students to explore and participate in project-based learning activities restoring the oyster population in and around New York Harbor. In Melaville, Berg and Blank’s Community Based Learning (2001) there is a statement that says, “Education must connect subject matter with the places where students live and the issues that affect us all”. Lessons engage students and teachers in long-term restoration ecology and environmental monitoring projects with STEM professionals and citizen scientists. In brief, partners have created curriculums for both in-school and out-of-school learning programs, an online platform for educators and students to collaborate, and exhibits with community partners to reinforce and extend both the educators’ and their students’ learning. Currently CCERS implementation involves: • 78 middle schools • 127 teachers • 110 scientist volunteers • Over 5000 K-12 students In this report, we present summative findings from data collected via surveys among three cohorts of students whose teachers were trained by the project’s curriculum and findings from interviews among project leaders to answer the following research questions: 1. Do the five programmatic pillars function independently and collectively as a system of interrelated STEM-C content delivery vehicles that also effectively change students’ and educators’ disposition towards STEM-C learning and environmental restoration and stewardship? 2. What comprises the "curriculum plus community enterprise" local model? 3. What are the mechanisms for creating sustainability and scalability of the model locally during and beyond its five-year implementation? 4. What core aspects of the model are replicable? Findings suggest the program improved students’ knowledge in life sciences but did not have a significant effect on students’ intent to become a scientist or affinity for science. Published by Sciedu Press 1 ISSN 2380-9183 E-ISSN 2380-9205 http://irhe.sciedupress.com International Research in Higher Education Vol. 3, No. 4; 2018 Interviews with project staff indicated that the key factors in the model were its conservation mission, partnerships, and the local nature of the issues involved. The primary mechanisms for sustainability and scalability beyond the five-year implementation were the digital platform, the curriculum itself, and the dissemination (with over 450 articles related to the project published in the media and academic journals). The core replicable aspects identified were the digital platform and adoption in other Keystone species contexts. 
    more » « less
  5. Broadening participation in the skilled technical workforce is a national priority given strong evidence of growing critical vacancies in engineering coupled with the urgent need for this workforce to better reflect the rich diversity of the nation. Scholars and activists often call for increased focus on education access, quality, and workforce development among rural Appalachian communities, noting that students from these communities are under-represented in higher education generally, and engineering careers specifically. Investing in preK-12 education, engaging youth as valued members of their communities, and cultivating workforce opportunities such as in advanced manufacturing have all been highlighted by the Appalachian Regional Commission as vital to strengthening economic resilience. However, scaffolding engineering and technical career pathways for Appalachian youth at scale in the context of broader systemic issues is challenging. Past research on the career choices of Appalachian youth show that sparked interest alone was not sufficient to consider engineering careers. Research on the sustained development of interest in engineering highlights rich networks of formal and informal experiences as catalysts or supportive infrastructure. Yet, access to such opportunities varies greatly. School systems often lack the necessary personnel, money, or space to offer these experiences, and, even if opportunities are available, often only a small subset of students may be able to participate. Further, common views of what engineering work is and who can do it are narrow, biased, and exclusive. This CAREER project has focused on three areas of research. The first area, focused on school-industry partnerships through COVID-19 in the region, highlighted the importance of rich partnerships, resilient stakeholders, and innovative contexts to persist throughout the COVID-19 pandemic. This is particularly pertinent to partnerships and collaboration, sustainability of these collaborations, and programming in the context of STEM skilled technical workforce development programs in rural places. The second area of research, focused on developing a conceptual framework for engineering education research and engagement in rural places, highlighted the importance of place, individual student and community assets, and leveraging these things to provide context and meaning in a decontextualized K-12 curriculum. Finally, the third research area, focused on systematically reviewing literature related to the assessment of systems thinking in K-12 education, highlighted the lack of comprehensive assessment tools that can apply across many educational disciplines but particularly in areas as it relates to socio-technical problems. Together, these three research areas ultimately seek to inform broader aspects of K-12 education, such as career and technical education, issues related to rural education, and ultimately focusing on students’ ability to handle complex problems in their communities or other contexts with systems thinking. 
    more » « less