skip to main content

Title: Design-Based Research: A Methodology to Extend and Enrich Biology Education Research
Recent calls in biology education research (BER) have recommended that researchers leverage learning theories and methodologies from other disciplines to investigate the mechanisms by which students to develop sophisticated ideas. We suggest design-based research from the learning sciences is a compelling methodology for achieving this aim. Design-based research investigates the “learning ecologies” that move student thinking toward mastery. These “learning ecologies” are grounded in theories of learning, produce measurable changes in student learning, generate design principles that guide the development of instructional tools, and are enacted using extended, iterative teaching experiments. In this essay, we introduce readers to the key elements of design-based research, using our own research into student learning in undergraduate physiology as an example of design-based research in BER. Then, we discuss how design-based research can extend work already done in BER and foster interdisciplinary collaborations among cognitive and learning scientists, biology education researchers, and instructors. We also explore some of the challenges associated with this methodological approach.  more » « less
Award ID(s):
1661263 1660643
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
CBE—Life Sciences Education
Page Range / eLocation ID:
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Biology education research (BER), currently conducted mostly at four‐year colleges and universities, is changing the culture of teaching biology and improving student success. We are community college faculty participating in the NSF‐funded CC Bio INSITES network, getting training and support in BER to ask questions to improve student success in our highly diverse classes. Our research adapts and validates existing BER surveys and interventions in Hispanic‐serving college settings, with pre‐health professions’ students, and with traditionally underserved populations in STEM. BER projects serve assessment and program review goals common across many community colleges, and when implemented with high‐impact practices, BER measures the gains in student retention and success. We call for support to continue changing the culture of discipline‐based education research at community colleges.

    more » « less
  2. null (Ed.)
    Teachers, schools, districts, states, and technology developers endeavor to personalize learning experiences for students, but definitions of personalized learning (PL) vary and designs often span multiple components. Variability in definition and implementation complicate the study of PL and the ways that designs can leverage student characteristics to reliably achieve targeted learning outcomes. We document the diversity of definitions of PL that guide implementation in educational settings and review relevant educational theories that could inform design and implementation. We then report on a systematic review of empirical studies of personalized learning using PRISMA guidelines. We identified 376 unique studies that investigated one or more PL design features and appraised this corpus to determine (1) who studies personalized learning; (2) with whom, and in what contexts; and (3) with focus on what learner characteristics, instructional design approaches, and learning outcomes. Results suggest that PL research is led by researchers in education, computer science, engineering, and other disciplines, and that the focus of their PL designs differs by the learner characteristics and targeted outcomes they prioritize. We further observed that research tends to proceed without a priori theoretical conceptualization, but also that designs often implicitly align to assumptions posed by extant theories of learning. We propose that a theoretically guided approach to the design and study of PL can organize efforts to evaluate the practice, and forming an explicit theory of change can improve the likelihood that efforts to personalize learning achieve their aims. We propose a theory-guided method for the design of PL and recommend research methods that can parse the effects obtained by individual design features within the “many-to-many-to-many” designs that characterize PL in practice. 
    more » « less
  3. null (Ed.)
    Purpose: We gathered examples from our extended collaboration to move educators move online while avoiding synchronous meetings. “gPortfolios” are public (to the class) pages where students write responses to carefully constructed engagement routines. Students then discuss their work with instructors and peers in threaded comments. gPortfolios usually include engagement reflections, formative self-assessments, and automated quizzes. These assessments support and document learning while avoiding instructor “burnout” from grading. gPortfolios can be implemented using Google Docs and Forms or any learning management system. Methodology. We report practical insights gained from design-based implementation research. This research explored the late Randi Engle’s principles for productive disciplinary engagement and expansive framing. Engle used current theories of learning to foster student discussions that were both authentic to the academic discipline at hand and productive for learning. This research also used new approaches to assessment to support Engle’s principles. This resulted in a comprehensive approach to online instruction and assessment that is effective and efficient for both students and teachers. Findings. Our approach “frames” (i.e., contextualizes) online engagement using each learners’ own experiences, perspectives, and goals. Writing this revealed how this was different in different courses. Secondary biology students framed each assignment independently. Secondary English and history students framed assignments as elements of a personalized capstone presentation; the history students further used a self-selected “historical theme.” Graduate students framed each assignment in an educational assessment course using a real or imagined curricular aim and context. Originality. Engle’s ideas have yet to be widely taken up in online education. 
    more » « less
  4. null (Ed.)
    Informal learning institutions, such as museums, science centers, and community-based organizations, play a critical role in providing opportunities for students to engage in science, technology, engineering, and mathematics (STEM) activities during out-of-school time hours. In recent years, thousands of studies, evaluations, and conference proceedings have been published measuring the impact that these programs have had on their participants. However, because studies of informal science education (ISE) programs vary considerably in how they are designed and in the quality of their designs, it is often quite difficult to assess their impact on participants. Knowing whether the outcomes reported by these studies are supported with sufficient evidence is important not only for maximizing participant impact, but also because there are considerable economic and human resources invested to support informal learning initiatives. To address this problem, I used the theories of impact analysis and triangulation as a framework for developing user-friendly rubrics for assessing quality of research designs and evidence of impact. I used two main sources, research-based recommendations from STEM governing bodies and feedback from a focus group, to identify criteria indicative of high-quality STEM research and study design. Accordingly, I developed three STEM Research Design Rubrics, one for quantitative studies, one for qualitative studies, and another for mixed methods studies, that can be used by ISE researchers, practitioners, and evaluators to assess research design quality. Likewise, I developed three STEM Impact Rubrics, one for quantitative studies, one for qualitative studies, and another for mixed methods studies, that can be used by ISE researchers, practitioners, and evaluators to assess evidence of outcomes. The rubrics developed in this study are practical tools that can be used by ISE researchers, practitioners, and evaluators to improve the field of informal science learning by increasing the quality of study design and for discerning whether studies or program evaluations are providing sufficient evidence of impact. 
    more » « less
  5. Tanner, Kimberly (Ed.)
    Two foundational concepts in biology education are 1) offspring are not identical to their parents, and 2) organisms undergo changes throughout their lives. These concepts are included in both international and U.S. curricular standards. Research in psychology has shown that children often have difficulty understanding these concepts, as they are inconsistent with their intuitive theories of the biological world. Additionally, prior research suggests that diagrams are commonly used in instruction and that their features influence student learning. Given this prior work, we explored the characteristics of life cycle diagrams and discuss possible implications for student learning. We examined 75 life cycle diagrams from books, including five biology or general science textbooks and 25 specialized trade books focusing on biology for children. We also examined 633 life cycle diagrams from a publicly available online database of science diagrams. Most diagrams failed to show any within-species variability. Additionally, many diagrams had perceptually rich backgrounds, which prior research suggests might hinder learning. We discuss how the design characteristics of diagrams may reinforce students’ intuitive theories of biology, which might make it difficult for students to understand key biological concepts in the future. 
    more » « less