skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Sample Sizes for 10 Types of Qualitative Data Analysis: An Integrative Review, Empirical Guidance, and Next Steps
There has been a recent explosion of articles on minimum sample sizes needed for analyzing qualitative data. The purpose of this integrated review is to examine this literature for 10 types of qualitative data analysis (5 types of saturation and 5 common methods). Building on established reviews and expanding to new methods, our findings extract the following sample size guidelines: theme saturation (9 interviews; 4 focus groups), meaning saturation (24 interviews; 8 focus groups), theoretical saturation (20–30+ interviews), metatheme saturation (20–40 interviews per site), and saturation in salience (10 exhaustive free lists); two methods where power analysis determines sample size: classical content analysis (statistical power analysis) and qualitative content analysis (information power); and three methods with little or no sample size guidance: reflexive thematic analysis, schema analysis, and ethnography (current guidance indicates 50–81 data documents or 20–30 interviews may be adequate). Our review highlights areas in which the extant literature does not provide sufficient sample size guidance—not because it is epistemologically flawed, but because it is not yet comprehensive and nuanced enough. To address this, we conclude by proposing ways researchers can navigate and contribute to the complex literature on sample size estimates.  more » « less
Award ID(s):
2143766 2017491
PAR ID:
10552129
Author(s) / Creator(s):
 ;  ;  
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
International Journal of Qualitative Methods
Volume:
23
ISSN:
1609-4069
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Jazizadeh, F; Shealy; T, Garvin (Ed.)
    Globalization has led to increased demand for international education and education experiences by domestic students. However, the current body of knowledge regarding these experiences is scarce and mostly dominated by subjective accounts. This paper explores the research content and methods necessary to capture the impact of an abroad education and research experience. This ongoing study combines bibliometric analysis, literature review, and qualitative analysis of selected articles. Based on the body of knowledge in social sciences, student competencies impacted by an international academic intervention incorporate the following knowledge domains: (1) intercultural competence; (2) professional development; (3) intellectual growth; (4) academic development; and (5) personal development. A comprehensive review of existing approaches for assessing international student experiences was also contrasted against accepted research procedures. While a mixed-methods approach to collect data via survey instruments and face-to-face interviews can enhance the depth and breadth of the observations, collecting data at different points in time enables the capture of both immediate and sustained impacts on the student. Besides self-reported data, the evaluation of the students’ research advisors and peers should also be conducted. 
    more » « less
  2. Langran, E. (Ed.)
    This work discusses ongoing experiences in creating interdisciplinary solutions to the development of cybersecurity/computer science skills for K-12 teachers. Participants for this work were K-12 teachers; the work was conducted during the summer semester of 2020. Nine K-12 teachers enrolled in the pilot course, and five K-12 teachers completed modules 0 & 1 of the cybersecurity course. This work describes a month long, self-paced cybersecurity micro-credential which consisted of an introduction to cybersecurity and the CIA Triad (Confidentiality, Integrity, and Accessibility). The primary research question explores the extent to which the cybersecurity micro-credential was considered helpful in understanding cybersecurity concepts and principles. The authors utilized quantitative and qualitative data collection via four methods: 1) content knowledge quiz (quantitative); 2) focus group (qualitative); 3) five semi-structured interviews (qualitative) and 4) two bi-weekly progress reports (qualitative). Qualitatively, focus group, semi-structured interview questions, and bi-weekly progress reports were coded and grouped into major themes by searching descriptive words. Quantitatively, a moderate positive relationship was found between post-test scores and total time in hours spent on modules 0 & 1. The main limitation is the sample size (n=5), which is too small to produce generalizable results. The work showcases innovative tools for teaching cybersecurity. 
    more » « less
  3. This methods paper presents the interview quality reflection tool (IQRT) to evaluate the quality of qualitative research interviews. Qualitative researchers commonly use semi-structured interviews that rely on the interviewers’ ability to improvise in real time based on the needs of the study. Given that interviewing involves numerous tacit skills that cannot be delineated by a simple written protocol, it is necessary that researchers develop interview competencies through practice and reflection. While prior literature on interviewing has often focused on developing interview protocols, we know little about how interviewers themselves may be trained to gather high-quality data. In this paper, we focus on how the IQRT may be used to guide the self-assessment of research interviews. We discuss how interviews are used in engineering education, how we developed and applied the IQRT, and how lessons learned through using this tool might lead to improved interviewing skills through careful examination of interview structure, content, and context within the mentoring process. 
    more » « less
  4. Methods to assess wood-based bioenergy projects have tended to focus on technological and physical constraints. Less is known about how longer-term environmental, economic, and social systems—the three pillars of sustainable development—have influenced technological development in the context of woody biomass energy. This research offers new methods for assessing the sustain- ability of wood-based energy projects by combining spatial analysis, semi-structured interviews, and archival data analysis. By integrating quantitative and qualitative methods, this project offers ways to understand how social and environmental dynamics from the past shape technological development in the future. A propensity analysis of biomass energy plants in Michigan, USA was performed using US Census data grouped by social, economic, and environmental categories. This quantitative analysis helped to characterize community and landscape types in which woody biomass plants were developed in Michigan in the late-twentieth century. To help illustrate some of the often-hidden social and political dimensions of energy development, such as access to decision-making and attitudes toward bioenergy projects, transcripts of public hearings, media coverage, and other archival sources were examined, and 30 stakeholder interviews were conducted. By integrating these qualitative and quantitative approaches, this paper aims to provide a more comprehensive approach to assessing the sustainability of wood-based biofuel technologies. 
    more » « less
  5. Abstract This mixed‐methods research focused on the implementation of a coordinated distributed experiment (CDE) investigating local adaptation in common milkweed (Asclepias syriaca), a host plant for the monarch butterfly population. Faculty participants were recruited from the Ecological Research as Education Network (EREN) who recruited their former undergraduate students. Quantitative data were drawn from the Milkweed Local Adaptation (MLA) CDE database across the three project years. Qualitative data included faculty survey responses, semi‐structured interviews of faculty and former undergraduates, and review of undergraduate research posters, papers, and curricula using rubrics aligned with 4DEE and Next Generation Science Standards (NGSS) benchmarks. Analysis of the MLA CDE database illustrates a decline in both participating institutions and in counts of milkweed stems over the project (2018–2020). Qualitative data analysis revealed that CDEs: (1) offer opportunities for higher education faculty and their students to be part of research including developing skills of data collection, analysis, and interpretation; (2) have unexpected challenges; and (3) can inspire undergraduate students to develop independent research projects or curricular modules for use in formal 6–12 classrooms. Broader ecological educational implications of our outcomes for higher education faculty and their undergraduate students include: (1) recommendation that faculty members involved ought to be proactively informed about potential challenges and provided with guidance on how to mitigate them; (2) mitigating challenges with model studies to try to estimate the sample size and redundancy likely to produce robust data; and (3) proactive use of the educational network to understand institutional use of the CDE project with undergraduates. 
    more » « less