skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023)
The explosion of AI across all facets of society has given rise to the need for AI education across domains and levels. AI literacy has become an important concept in the current technological landscape, emphasizing the need for individuals to acquire the necessary knowledge and skills to engage with AI systems. This systematic review examined 47 articles published between 2019 and 2023, focusing on recent work to capture new insights and initiatives given the burgeoning of the literature on this topic. In the initial stage, we explored the dataset to identify the themes covered by the selected papers and the target population for AI literacy efforts. We identified that the articles broadly contributed to one of the following themes: a) conceptualizing AI literacy, b) prompting AI literacy efforts, and c) developing AI literacy assessment instruments. We also found that a range of populations, from pre-K students to adults in the workforce, were targeted. In the second stage, we conducted a thorough content analysis to synthesize six key constructs of AI literacy: Recognize, Know and Understand, Use and Apply, Evaluate, Create, and Navigate Ethically. We then applied this framework to categorize a range of empirical studies and identify the prevalence of each construct across the studies. We subsequently review assessment instruments developed for AI literacy and discuss them. The findings of this systematic review are relevant for formal education and workforce preparation and advancement, empowering individuals to leverage AI and drive innovation.  more » « less
Award ID(s):
2319137 1954556
PAR ID:
10589957
Author(s) / Creator(s):
; ;
Publisher / Repository:
Elsevier
Date Published:
Journal Name:
Computers and Education Open
Volume:
6
Issue:
C
ISSN:
2666-5573
Page Range / eLocation ID:
100173
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The emergence of increasingly powerful AI technologies calls for the design and development of K-12 AI literacy curricula that can support students who will be entering a profoundly changed labor market. However, developing, implementing, and scaling AI literacy curricula poses significant challenges. It will be essential to develop a robust, evidence-based AI education research foundation that can inform AI literacy curriculum development. Unlike K-12 science and mathematics education, there is not currently a research foundation for K-12 AI education. In this article we provide a component-based definition of AI literacy, present the need for implementing AI literacy education across all grade bands, and argue for the creation of research programs across four areas of AI education: (1) K-12 AI Learning & Technology; (2) K-12 AI Education Integration into STEM, Language Arts, and Social Science Education; (3) K-12 AI Professional Development for Teachers and Administrators; and (4) K-12 AI Assessment. 
    more » « less
  2. The term “nontraditional students” (NTS) is widely used in higher education research, but its definition varies across studies. Objectives This systematic literature review aims to examine how researchers define NTS in U.S.-based studies and identify potential definitional issues. Methods We conducted a systematic review following PRISMA guidelines, searching EBSCO databases (Education Research Complete, Education Full Text, and ERIC) for peer-reviewed articles published between 2018 and 2022. We analyzed 65 papers that met our inclusion criteria to assess the definitions used for NTS. In this systematic literature review we focus on the definitional issues related to how researchers use the term nontraditional students in US-based studies. We review 65 papers from search results containing 432 papers to understand how researchers define nontraditional students. Of the 65 papers reviewed fully, 33 papers included a specific definition of nontraditional students, 15 included an unspecified definition of nontraditional students, and 17 papers did not include a clear definition at all. Our work suggests that researchers use a clearer definition, such as from the NCES, to define nontraditional students and focus their attention on the seven categories given by NCES. 
    more » « less
  3. As artificial intelligence (AI) becomes more prominent in children’s lives, an increasing number of researchers and practitioners have underscored the importance of integrating AI as learning content in K-12. Despite the recent efforts in developing AI curricula and guiding frameworks in AI education, the educational opportunities often do not provide equally engaging and inclusive learning experiences for all learners. To promote equality and equity in society and increase competitiveness in the AI workforce, it is essential to broaden participation in AI education. However, a framework that guides teachers and learning designers in designing inclusive learning opportunities tailored for AI education is lacking. Universal Design for Learning (UDL) provides guidelines for making learning more inclusive across disciplines. Based on the principles of UDL, this paper proposes a framework to guide the design of inclusive AI learning. We conducted a systematic literature review to identify AI learning design-related frameworks and synthesized them into our proposed framework, which includes the core component of AI learning content (i.e., five big ideas), anchored by the three UDL principles (the “why,” “what,” and “how” of learning), and six praxes with pedagogical examples of AI instruction. Alongside this, we present an illustrative example of the application of our proposed framework in the context of a middle school AI summer camp. We hope this paper will guide researchers and practitioners in designing more inclusive AI learning experiences. 
    more » « less
  4. Biochemistry relies heavily on the use of images and diagrams to make the abstract tangible. Yet, as biochemistry instructors, how do we know whether our students see the same things we instructors see? BioMolViz (biomolviz.org) is a community of practice dedicated to the instruction and assessment of biomolecular visual literacy. To this end, BioMolViz created the Biomolecular Visualization Framework, an assessment tool that identifies more than 200 learning objectives clustered under twelve overarching themes, such as StructureFunction and Alternate Renderings. The team is currently assembling a searchable repository to host assessment instruments for each of these learning objectives. To aid in its construction, BioMolViz is recruiting participants to help write, revise, and pilot these instruments in the classroom. Here, we introduce the Framework, share various BioMolViz projects, and invite likeminded individuals to work with us to build students’ biomolecular visual literacy. 
    more » « less
  5. This research-to-practice paper presents a curriculum, “AI Literacy for All,” to promote an interdisciplinary under-standing of AI, its socio-technical implications, and its practical applications for all levels of education. With the rapid evolution of artificial intelligence (AI), there is a need for AI literacy that goes beyond the traditional AI education curriculum. AI literacy has been conceptualized in various ways, including public literacy, competency building for designers, conceptual understanding of AI concepts, and domain-specific upskilling. Most of these conceptualizations were established before the public release of Generative AI (Gen-AI) tools such as ChatGPT. AI education has focused on the principles and applications of AI through a technical lens that emphasizes the mastery of AI principles, the mathematical foundations underlying these technologies, and the programming and mathematical skills necessary to implement AI solutions. The non-technical component of AI literacy has often been limited to social and ethical implications, privacy and security issues, or the experience of interacting with AI. In AI Literacy for all, we emphasize a balanced curriculum that includes technical as well as non-technical learning outcomes to enable a conceptual understanding and critical evaluation of AI technologies in an interdisciplinary socio-technical context. The paper presents four pillars of AI literacy: understanding the scope and technical dimensions of AI, learning how to interact with Gen-AI in an informed and responsible way, the socio-technical issues of ethical and responsible AI, and the social and future implications of AI. While it is important to include all learning outcomes for AI education in a Computer Science major, the learning outcomes can be adjusted for other learning contexts, including, non-CS majors, high school summer camps, the adult workforce, and the public. This paper advocates for a shift in AI literacy education to offer a more interdisciplinary socio-technical approach as a pathway to broaden participation in AI. This approach not only broadens students' perspectives but also prepares them to think critically about integrating AI into their future professional and personal lives. 
    more » « less