skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Design Considerations for a Multiple-Choice Assessment of Socio-Scientific Systems Thinking
This design case details the design process of a multiple-choice assessment of socio-scientific systems thinking. This assessment is situated within a larger project that aims to understand the ways students use multiple scientific models to understand complex socio-scientific issues. In addition to the research component, this project entails developing curriculum and assessment resources that support science teaching and learning. We begin this paper by framing the needs that motivated the design of this assessment and introducing the design team. We then present a narrative outlining the design process, focusing on key challenges that arose and the ways these challenges influenced our final design. We conclude this paper with a discussion of the compromises that had to be made in the process of designing this instrument.  more » « less
Award ID(s):
2101083
PAR ID:
10532041
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Indiana University
Date Published:
Journal Name:
International Journal of Designs for Learning
Volume:
15
Issue:
1
ISSN:
2159-449X
Page Range / eLocation ID:
27 to 37
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, International Society of the Learning Sciences)
    Chinn, C; Tan, E.; Chan, C.; Kali, Y. (Ed.)
    Socio-ecological histories of places are political, contested, and intimately linked with ways of knowing and being in the world. Supporting students in perspective taking and reasoning through contested histories of places are equity practices that allow for multiple and diverse stories to be told, honored, and incorporated in science learning. In this paper, we describe an approach to teaching about socio ecological systems from the Learning in Places project using a framework called Socioecological Histories of Places. We first describe the framework and its design within the Learning in Places project. We then analyze one teacher’s implementation of this approach and discuss implications for understanding issues of power, historicity, and ethical decision-making in field-based science learning and teaching. 
    more » « less
  2. ; ; ; (, Educational designer)
    Contemporary views on what students should learn increasingly emphasize that students need to acquire more than a base of knowledge; they need to acquire the skills and abilities to use such knowledge in dynamic and flexible ways. To be most effective, learning environments need assessments that are aligned to these perspectives. Using a principled design framework can help guide assessment development toward such targets. Even when using a framework, however, thorny design challenges may arise. Technology-enhanced assessments offer opportunities to overcome such challenges but are not a solution in and of themselves and can also introduce new challenges. In this paper, we describe three challenges (conflict between multiple dimensions of science proficiency, authentic data, and grade-appropriate graphing tools) that we faced when designing for a specific Next Generation Science Standard, and the theoretical and design principles that guided us as we ideated design solutions. Through these designs we maintained alignment to our multidimensional assessment targets, a critical component of our larger assessment validity argument. 
    more » « less
  3. ; ; ; (, Frontiers in Education)
    Research on socio-scientific issues (SSI) has revealed that it is critical for learners to develop a systematic understanding of the underlying issue. In this paper, we explore how modeling can facilitate students’ systems thinking in the context of SSI. Building on evidence from prior research in promoting systems thinking skills through modeling in scientific contexts, we hypothesize that a similar modeling approach could effectively foster students’ systematic understanding of complex societal issues. In particular, we investigate the affordances of socio-scientific models in promoting students’ systems thinking in the context of COVID-19. We examine learners’ experiences and reflections concerning three unique epistemic features of socio-scientific models, (1) knowledge representation, (2) knowledge justification, and (3) systems thinking. The findings of this study demonstrate that, due to the epistemic differences from traditional scientific modeling approach, engaging learners in developing socio-scientific models presents unique opportunities and challenges for SSI teaching and learning. It provides evidence that, socio-scientific models can serve as not only an effective but also an equitable tool for addressing this issue. 
    more » « less
  4. ; ; ; ; ; (, Science Education)
    Abstract Despite the importance of developing elementary science teachers' content knowledge for teaching (CKT), there are limited assessments that have been designed to measure the full breadth of their CKT at scale. Our overall research project addressed this gap by developing an online assessment to measure elementary preservice teachers' CKT about matter and its interactions. This study, which was part of our larger project, reports on findings from one component of the item development process examining the construct validity of 118 different CKT about matter assessment items. In this study, 86 elementary teachers participated in cognitive interviews to examine: (a) the knowledge and reasoning they used when responding to these CKT about matter assessment items and (b) the nature of the content challenges and the content teaching challenges they encountered. Findings showed that over 80% of participant interview responses indicated that the CKT about matter items functioned as hypothesized, providing evidence to support future use of these items on a large‐scale assessment and in studies of science teachers' CKT. When responding to the items, participants showed evidence of four main challenges with the science content: (a) using scientific concepts to reason about science tasks, (b) using adequate evidence to reason about science phenomenon, (c) drawing upon examples of scientific phenomena, and (d) drawing upon science vocabulary. Findings also showed that participants experienced challenges regarding the following content teaching aspects when responding to these items: (a) connecting to key scientific concepts involved in the work of teaching science, (b) attending to instructional goal(s), and (c) recognizing features of grade‐level appropriateness. Implications for using CKT items as part of large‐scale science assessment systems and identifying areas to target in elementary science teachers' CKT development are addressed. 
    more » « less
  5. ; ; ; ; ; ; ; (, Annual Meeting of NARST)
    Making sense of what to do about the many daunting socio-environmental issues that we face will require intercultural understanding, openness to learning, and a capacity to draw on the strengths of multiple perspectives and to recognize limitations of dominant perspectives such as Eurocentric science. Navigating multiple perspectives in the school science classroom can be particularly treacherous for Indigenous students, whose cultural worldviews have often been excluded or denigrated in Eurocentric educational contexts. We present findings from a partnership project that is designing, implementing, studying, and refining instructional experiences for middle school students from significantly/predominantly Indigenous communities in Alaska and Hawai’i. This paper describes our efforts to understand project partners’ standpoints, acknowledging that in designing and implementing multi-perspective middle school science instruction, it will be critical to understand the multiple perspectives that we ourselves bring to the work. We present and discuss the views that project partners (including teachers) have shared concerning science, science education, multiple perspectives, and Indigenous cultural integrity and potential consequentiality for the project’s collaborative work. Five prominent themes relate to (1) the challenge of defining Indigenous and Eurocentric science for application in an instructional design context, (2) relationships with place, (3) centrality of language, (4) scaffolding and understanding learning through a multi-perspective lens, and (5) constraints associated with Eurocentric classroom and science contexts. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email