skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Sample Sizes for 10 Types of Qualitative Data Analysis: An Integrative Review, Empirical Guidance, and Next Steps
There has been a recent explosion of articles on minimum sample sizes needed for analyzing qualitative data. The purpose of this integrated review is to examine this literature for 10 types of qualitative data analysis (5 types of saturation and 5 common methods). Building on established reviews and expanding to new methods, our findings extract the following sample size guidelines: theme saturation (9 interviews; 4 focus groups), meaning saturation (24 interviews; 8 focus groups), theoretical saturation (20–30+ interviews), metatheme saturation (20–40 interviews per site), and saturation in salience (10 exhaustive free lists); two methods where power analysis determines sample size: classical content analysis (statistical power analysis) and qualitative content analysis (information power); and three methods with little or no sample size guidance: reflexive thematic analysis, schema analysis, and ethnography (current guidance indicates 50–81 data documents or 20–30 interviews may be adequate). Our review highlights areas in which the extant literature does not provide sufficient sample size guidance—not because it is epistemologically flawed, but because it is not yet comprehensive and nuanced enough. To address this, we conclude by proposing ways researchers can navigate and contribute to the complex literature on sample size estimates.  more » « less
Award ID(s):
2143766 2017491
PAR ID:
10552129
Author(s) / Creator(s):
 ;  ;  
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
International Journal of Qualitative Methods
Volume:
23
ISSN:
1609-4069
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Jazizadeh, F; Shealy; T, Garvin (Ed.)
    Globalization has led to increased demand for international education and education experiences by domestic students. However, the current body of knowledge regarding these experiences is scarce and mostly dominated by subjective accounts. This paper explores the research content and methods necessary to capture the impact of an abroad education and research experience. This ongoing study combines bibliometric analysis, literature review, and qualitative analysis of selected articles. Based on the body of knowledge in social sciences, student competencies impacted by an international academic intervention incorporate the following knowledge domains: (1) intercultural competence; (2) professional development; (3) intellectual growth; (4) academic development; and (5) personal development. A comprehensive review of existing approaches for assessing international student experiences was also contrasted against accepted research procedures. While a mixed-methods approach to collect data via survey instruments and face-to-face interviews can enhance the depth and breadth of the observations, collecting data at different points in time enables the capture of both immediate and sustained impacts on the student. Besides self-reported data, the evaluation of the students’ research advisors and peers should also be conducted. 
    more » « less
  2. Langran, E. (Ed.)
    This work discusses ongoing experiences in creating interdisciplinary solutions to the development of cybersecurity/computer science skills for K-12 teachers. Participants for this work were K-12 teachers; the work was conducted during the summer semester of 2020. Nine K-12 teachers enrolled in the pilot course, and five K-12 teachers completed modules 0 & 1 of the cybersecurity course. This work describes a month long, self-paced cybersecurity micro-credential which consisted of an introduction to cybersecurity and the CIA Triad (Confidentiality, Integrity, and Accessibility). The primary research question explores the extent to which the cybersecurity micro-credential was considered helpful in understanding cybersecurity concepts and principles. The authors utilized quantitative and qualitative data collection via four methods: 1) content knowledge quiz (quantitative); 2) focus group (qualitative); 3) five semi-structured interviews (qualitative) and 4) two bi-weekly progress reports (qualitative). Qualitatively, focus group, semi-structured interview questions, and bi-weekly progress reports were coded and grouped into major themes by searching descriptive words. Quantitatively, a moderate positive relationship was found between post-test scores and total time in hours spent on modules 0 & 1. The main limitation is the sample size (n=5), which is too small to produce generalizable results. The work showcases innovative tools for teaching cybersecurity. 
    more » « less
  3. This methods paper presents the interview quality reflection tool (IQRT) to evaluate the quality of qualitative research interviews. Qualitative researchers commonly use semi-structured interviews that rely on the interviewers’ ability to improvise in real time based on the needs of the study. Given that interviewing involves numerous tacit skills that cannot be delineated by a simple written protocol, it is necessary that researchers develop interview competencies through practice and reflection. While prior literature on interviewing has often focused on developing interview protocols, we know little about how interviewers themselves may be trained to gather high-quality data. In this paper, we focus on how the IQRT may be used to guide the self-assessment of research interviews. We discuss how interviews are used in engineering education, how we developed and applied the IQRT, and how lessons learned through using this tool might lead to improved interviewing skills through careful examination of interview structure, content, and context within the mentoring process. 
    more » « less
  4. Methods to assess wood-based bioenergy projects have tended to focus on technological and physical constraints. Less is known about how longer-term environmental, economic, and social systems—the three pillars of sustainable development—have influenced technological development in the context of woody biomass energy. This research offers new methods for assessing the sustain- ability of wood-based energy projects by combining spatial analysis, semi-structured interviews, and archival data analysis. By integrating quantitative and qualitative methods, this project offers ways to understand how social and environmental dynamics from the past shape technological development in the future. A propensity analysis of biomass energy plants in Michigan, USA was performed using US Census data grouped by social, economic, and environmental categories. This quantitative analysis helped to characterize community and landscape types in which woody biomass plants were developed in Michigan in the late-twentieth century. To help illustrate some of the often-hidden social and political dimensions of energy development, such as access to decision-making and attitudes toward bioenergy projects, transcripts of public hearings, media coverage, and other archival sources were examined, and 30 stakeholder interviews were conducted. By integrating these qualitative and quantitative approaches, this paper aims to provide a more comprehensive approach to assessing the sustainability of wood-based biofuel technologies. 
    more » « less
  5. Fankhauser, Sarah (Ed.)
    ABSTRACT This integrative literature review analyzes the corpus of biology education research published in the main biology education journals of major professional societies. The goal of this analysis is to determine which approaches (including groups of focus, research methods, and settings/perspectives) from social science fields (i.e., psychology, sociology, and anthropology) are utilized in published peer-reviewed biology education research relating to diversity, equity, and inclusion (DEI). Scoping how social science approaches are used in this area is important to understanding whether biology education research could benefit from complementary approaches that might advance praxis. This analysis found that research informing the biology education community draws heavily from psychological perspectives that are overwhelmingly not disaggregated (78% of articles identifying a group lumped the participant together), are by far more quantitative (58% used survey, 26% grades, 20% school data) than qualitative (17% used interview, 10% observation), and did not adopt structural approaches (72%). The addition of missing contributions from social science is critical to advancing interventions to broaden STEM participation, given that merging paradigms can offer more robust, multi-level explanations for observed phenomena. This has important implications for education, biology education, biology education research, social science, and research in related STEM fields. 
    more » « less