An official website of the United States government
Concept inventories are standardized assessments that evaluate student understanding of key concepts within academic disciplines. While prevalent across STEM fields, their development lags for advanced computer science topics like dynamic programming (DP)---an algorithmic technique that poses significant conceptual challenges for undergraduates. To fill this gap, we developed and validated a Dynamic Programming Concept Inventory (DPCI). We detail the iterative process used to formulate multiple-choice questions targeting known student misconceptions about DP concepts identified through prior research studies. We discuss key decisions, tradeoffs, and challenges faced in crafting probing questions to subtly reveal these conceptual misunderstandings. We conducted a preliminary psychometric validation by administering the DPCI to 172 undergraduate CS students finding our questions to be of appropriate difficulty and effectively discriminating between differing levels of student understanding. Taken together, our validated DPCI will enable instructors to accurately assess student mastery of DP. Moreover, our approach for devising a concept inventory for an advanced theoretical computer science concept can guide future efforts to create assessments for other under-evaluated areas currently lacking coverage.
more »
« less
Unveiling the nature of a miniature world: a horizon scan of fundamental questions in bryology
Introduction. Half a century since the creation of the International Association of Bryologists, we carried out a review to identify outstanding challenges and future perspectives in bryology. Specifically, we have identified 50 fundamental questions that are critical in advancing the discipline. Methods. We have adapted a deep-rooted methodology of horizon scanning to identify key research foci. An initial pool of 258 questions was prepared by a multidisciplinary and international working group of 32 bryologists. A series of online surveys completed by a broader community of researchers in bryology, followed by quality-control steps implemented by the working group, were used to create a list of top-priority questions. This final list was restricted to 50 questions with a broad conceptual scope and answerable through realistic research approaches. Key results. The top list of 50 fundamental questions was organised into four general topics: Bryophyte Biodiversity and Biogeography; Bryophyte Ecology, Physiology and Reproductive Biology; Bryophyte Conservation and Management; and Bryophyte Evolution and Systematics. These topics included 9, 19, 14 and 8 questions, respectively. Conclusions. Although many of the research challenges identified are not newly conceived, our horizon-scanning exercise has established a significant foundation for future bryological research. We suggest analytical and conceptual strategies and novel developments for potential use in advancing the research agenda for bryology.
more »
« less
- Award ID(s):
- 1753811
- PAR ID:
- 10336707
- Author(s) / Creator(s):
- ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »
- Date Published:
- Journal Name:
- Journal of bryology
- Volume:
- 41
- ISSN:
- 1743-2820
- Page Range / eLocation ID:
- 1 - 34
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract The Laser Interferometer Space Antenna (LISA) has the potential to reveal wonders about the fundamental theory of nature at play in the extreme gravity regime, where the gravitational interaction is both strong and dynamical. In this white paper, the Fundamental Physics Working Group of the LISA Consortium summarizes the current topics in fundamental physics where LISA observations of gravitational waves can be expected to provide key input. We provide the briefest of reviews to then delineate avenues for future research directions and to discuss connections between this working group, other working groups and the consortium work package teams. These connections must be developed for LISA to live up to its science potential in these areas.more » « less
-
Conceptual design is the foundational stage of a design process that translates ill-defined design problems into low-fidelity design concepts and prototypes through design search, creation, and integration. In this stage, product shape design is one of the most paramount aspects. When applying deep learning-based methods to product shape design, two major challenges exist: (1) design data exhibit in multiple modalities and (2) an increasing demand for creativity. With recent advances in deep learning of cross-modal tasks (DLCMTs), which can transfer one design modality to another, we see opportunities to develop artificial intelligence (AI) to assist the design of product shapes in a new paradigm. In this paper, we conduct a systematic review of the retrieval, generation, and manipulation methods for DLCMT that involve three cross-modal types: text-to-3D shape, text-to-sketch, and sketch-to-3D shape. The review identifies 50 articles from a pool of 1341 papers in the fields of computer graphics, computer vision, and engineering design. We review (1) state-of-the-art DLCMT methods that can be applied to product shape design and (2) identify the key challenges, such as lack of consideration of engineering performance in the early design phase that need to be addressed when applying DLCMT methods. In the end, we discuss the potential solutions to these challenges and propose a list of research questions that point to future directions of data-driven conceptual design.more » « less
-
On June 4-6, 2019, the NSTC NITRD Program, in collaboration with NSTC’s MLAI Subcommittee, held a workshop to assess the research challenges and opportunities at the intersection of cybersecurity and artificial intelligence. The workshop brought together senior members of the government, academic, and industrial communities to discuss the current state of the art and future research needs, and to identify key research gaps.This report is a summary of those discussions,framed around research questions and possible topics for future research directions.more » « less
-
Abstract Participatory approaches to science and decision making, including stakeholder engagement, are increasingly common for managing complex socio-ecological challenges in working landscapes. However, critical questions about stakeholder engagement in this space remain. These include normative, political, and ethical questions concerning who participates, who benefits and loses, what good can be accomplished, and for what, whom, and by who. First, opportunities for addressing justice, equity, diversity, and inclusion interests through engagement, while implied in key conceptual frameworks, remain underexplored in scholarly work and collaborative practice alike. A second line of inquiry relates to research–practice gaps. While both the practice of doing engagement work and scholarly research on the efficacy of engagement is on the rise, there is little concerted interplay among ‘on-the-ground’ practitioners and scholarly researchers. This means scientific research often misses or ignores insight grounded in practical and experiential knowledge, while practitioners are disconnected from potentially useful scientific research on stakeholder engagement. A third set of questions concerns gaps in empirical understanding of the efficacy of engagement processes and includes inquiry into how different engagement contexts and process features affect a range of behavioral, cognitive, and decision-making outcomes. Because of these gaps, a cohesive and actionable research agenda for stakeholder engagement research and practice in working landscapes remains elusive. In this review article, we present a co-produced research agenda for stakeholder engagement in working landscapes. The co-production process involved professionally facilitated and iterative dialogue among a diverse and international group of over 160 scholars and practitioners through a yearlong virtual workshop series. The resulting research agenda is organized under six cross-cutting themes: (1) Justice, Equity, Diversity, and Inclusion; (2) Ethics; (3) Research and Practice; (4) Context; (5) Process; and (6) Outcomes and Measurement. This research agenda identifies critical research needs and opportunities relevant for researchers, practitioners, and policymakers alike. We argue that addressing these research opportunities is necessary to advance knowledge and practice of stakeholder engagement and to support more just and effective engagement processes in working landscapes.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1080/03736687.2022.2054615
