Visualization misinformation is a prevalent problem, and combating it requires understanding people’s ability to read, interpret, and reason about erroneous or potentially misleading visualizations, which lacks a reliable measurement: existing visualization literacy tests focus on well-formed visualizations. We systematically develop an assessment for this ability by: (1) developing a precise definition of misleaders (decisions made in the construction of visualizations that can lead to conclusions not supported by the data), (2) constructing initial test items using a design space of misleaders and chart types, (3) trying out the provisional test on 497 participants, and (4) analyzing the test tryout results and refining the items using Item Response Theory, qualitative analysis, a wrong-due-to-misleader score, and the content validity index. Our final bank of 45 items shows high reliability, and we provide item bank usage recommendations for future tests and different use cases. Related materials are available at: https://osf.io/pv67z/.
more »
« less
Data visualization literacy: Definitions, conceptual frameworks, exercises, and assessments
In the information age, the ability to read and construct data visualizations becomes as important as the ability to read and write text. However, while standard definitions and theoretical frameworks to teach and assess textual, mathematical, and visual literacy exist, current data visualization literacy (DVL) definitions and frameworks are not comprehensive enough to guide the design of DVL teaching and assessment. This paper introduces a data visualization literacy framework (DVL-FW) that was specifically developed to define, teach, and assess DVL. The holistic DVL-FW promotes both the reading and construction of data visualizations, a pairing analogous to that of both reading and writing in textual literacy and understanding and applying in mathematical literacy. Specifically, the DVL-FW defines a hierarchical typology of core concepts and details the process steps that are required to extract insights from data. Advancing the state of the art, the DVL-FW interlinks theoretical and procedural knowledge and showcases how both can be combined to design curricula and assessment measures for DVL. Earlier versions of the DVL-FW have been used to teach DVL to more than 8,500 residential and online students, and results from this effort have helped revise and validate the DVL-FW presented here.
more »
« less
- Award ID(s):
- 1839167
- PAR ID:
- 10110106
- Date Published:
- Journal Name:
- Proceedings of the National Academy of Sciences
- Volume:
- 116
- Issue:
- 6
- ISSN:
- 0027-8424
- Page Range / eLocation ID:
- 1857 to 1864
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Co-reading (when parents read aloud with their children) is an important literacy development activity for children. HCI has begun to explore how technology might support children in co-reading, but little empirical work examines how parents currently co-read, and no work examines how people with visual impairments (PWVI) co-read. PWVIs' perspectives offer unique insights into co-reading, as PWVI often read differently from their children, and (Braille) literacy holds particular cultural significance for PWVI. We observed discussions of co-reading practices in a blind parenting forum on Facebook, to establish a grounded understanding of how and why PWVI co-read. We found that PWVIs' co-reading practices were highly diverse and affected by a variety of socio-technical concerns - and visual ability was less influential than other factors like ability to read Braille, presence of social supports, and children's literacy. Our findings show that PWVI have valuable insights into co-reading, which could help technologies in this space better meet the needs of parents and children, with and without disabilities.more » « less
-
Abstract In this study, support for teaching data literacy in social studies is provided through the design of a pedagogical support system informed by participatory design sessions with both pre‐service and in‐service social studies teachers. It provides instruction on teaching and learning data literacy in social studies, examples of standards‐based lesson plans, made‐to‐purpose data visualization tools and minimal manuals that put existing online tools in a social studies context. Based on case studies of eleven practicing teachers, this study provides insight into features of technology resources that social studies teachers find usable and useful for using data visualizations as part of standards‐ and inquiry‐based social studies instruction, teaching critical analysis of data visualizations and helping students create data visualizations with online computing tools. The final result, though, is that few of our participating teachers have yet adopted the provided resources into their own classrooms, which highlights weaknesses of the technology acceptance model for describing teacher adoption. Practitioner notesWhat is already known about this topicData literacy is an important part of social studies education in the United States.Most teachers do not teach data literacy as a part of social studies.Teachers may adopt technology to help them teach data literacy if they think it is useful and usable.What this paper addsEducational technology can help teachers learn about data literacy in social studies.Social studies teachers want simple tools that fit with their existing curricula, give them new project ideas and help students learn difficult concepts.Making tools useful and usable does not predict adoption; context plays a large role in a social studies teachers' adoption.Implications for practice and/or policyDesigning purpose‐built tools for social studies teachers will encourage them to teach data literacy in their classes.Professional learning opportunities for teachers around data literacy should include opportunities for experimentation with tools.Teachers are not likely to use tools if they are not accompanied by lesson and project ideas.more » « less
-
Data visualization literacy is essential for K-12 students, yet existing practices emphasize interpreting pre-made visualizations rather than creating them. To address this, we developed the DPV (Domain, Purpose, Visual) framework, which guides middle school students through the visualization design process. The framework simplifies design into three stages: understanding the problem domain, specifying the communication purpose, and translating data into effective visuals. Implemented in a twoweek summer camp as a usage scenario, the DPV framework enabled students to create visualizations addressing community issues. Evaluation of student artifacts, focus group interviews, and surveys demonstrated its effectiveness in enhancing students' design skills and understanding of visualization concepts. This work highlights the DPV framework's potential to foster data visualization literacy for K-12 education and broaden participation in the data visualization community.more » « less
-
null (Ed.)Purpose This paper aims to explore what design aspects can support data visualization literacy within science museums. Design/methodology/approach The qualitative study thematically analyzes video data of 11 visitor groups as they engage with reading and writing of data visualization through a science museum exhibition that features real-time and uncurated data. Findings Findings present how the design aspects of the exhibit led to identifying single data records, data patterns, mismeasurements and distribution rate. Research limitations/implications The findings preface how to study data visualization literacy learning in short museum interactions. Practical implications Practically, the findings point toward design implications for facilitating data visualization literacy in museum exhibits. Originality/value The originality of the study lays in the way the exhibit supports engagement with data visualization literacy with uncurated data records.more » « less
An official website of the United States government

