A common claim about the affluent democracies is that protest is trending, becoming more legitimate and widely used by all political contenders. In the new democracies, protest is seen as having contributed to democratization, but growing apathy has led to protest decline while in authoritarian regimes protest may be spurring more democratization. Assessing these ideas requires comparative trend data covering 15 or more years but constructing such data confronts problems. The major problem is that the most available survey item asks “have you ever joined (lawful) demonstrations,” making it difficult to time when this protest behavior occurred. We advance a novel method for timing these “ever” responses by focusing on young adults (aged 18-23 years), who are likely reporting on participation within the past 5 years. Drawing on the Survey Data Recycling harmonized data set, we use a multilevel model including harmonization and survey quality controls to create predicted probabilities for young adult participation (576 surveys, 119 countries, 1966-2010). Aggregating these to create country-year rate estimates, these compare favorably with overlapping estimates from surveys asking about “the past 5 years or so” and event data from the PolDem project. Harmonization and survey quality controls improve these predicted values. These data provide 15+ years trend estimates for 60 countries, which we use to illustrate the possibilities of estimating comparative protest trends.
more »
« less
Measuring and Analyzing Protest Potential From a Survey Data Recycling Framework
As active involvement in protest has been legitimized as an acceptable form of political activity, citizens’ protest potential has become an important measure to understand contemporary democratic politics. However, the arbitrary use of a forced-choice question, which prevents those who have previously participated in protests from expressing willingness to engage in future protest, and the limited coverage of international surveys across countries and years have impeded comparative research on protest potential. This research develops a new systematic weighting method for the measurement of protest potential for comparative research. Using the 1996 International Social Survey Program survey, which asks two separate questions about “have done” and “would do” demonstrations, I create a weighting scale for the forced-choice question by estimating the predicted probabilities of protest potential for those who have already participated in demonstrations. Capitalizing on the survey data recycling framework, this study also controls for harmonization procedures and the quality of surveys, thereby expanding the cross-national and temporal coverage beyond the affluent Western democracies. The results show that this weighting scale provides a valid measure of protest potential, and the survey data recycling framework improves comparability between surveys.
more »
« less
- Award ID(s):
- 1738502
- PAR ID:
- 10337332
- Date Published:
- Journal Name:
- American Behavioral Scientist
- Volume:
- 66
- Issue:
- 4
- ISSN:
- 0002-7642
- Page Range / eLocation ID:
- 434 to 458
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This article proposes a new approach to analyze protest participation measured in surveys of uneven quality. Because single international survey projects cover only a fraction of the world’s nations in specific periods, researchers increasingly turn to ex-post harmonization of different survey data sets not a priori designed as comparable. However, very few scholars systematically examine the impact of the survey data quality on substantive results. We argue that the variation in source data, especially deviations from standards of survey documentation, data processing, and computer files—proposed by methodologists of Total Survey Error, Survey Quality Monitoring, and Fitness for Intended Use—is important for analyzing protest behavior. In particular, we apply the Survey Data Recycling framework to investigate the extent to which indicators of attending demonstrations and signing petitions in 1,184 national survey projects are associated with measures of data quality, controlling for variability in the questionnaire items. We demonstrate that the null hypothesis of no impact of measures of survey quality on indicators of protest participation must be rejected. Measures of survey documentation, data processing, and computer records, taken together, explain over 5% of the intersurvey variance in the proportions of the populations attending demonstrations or signing petitions.more » « less
-
Public opinion surveys constitute a widespread, powerful tool to study peoples’ attitudes and behaviors from comparative perspectives. However, even global surveys can have limited geographic and temporal coverage, which can hinder the production of comprehensive knowledge. To expand the scope of comparison, social scientists turn to ex-post harmonization of variables from datasets that cover similar topics but in different populations and/or at different times. These harmonized datasets can be analyzed as a single source and accessed through various data portals. However, the Survey Data Recycling (SDR) research project has identified three challenges faced by social scientists when using data portals: the lack of capability to explore data in-depth or query data based on customized needs, the difficulty in efficiently identifying related data for studies, and the incapability to evaluate theoretical models using sliced data. To address these issues, the SDR research project has developed the SDR Querier, which is applied to the harmonized SDR database. The SDR Querier includes a BERT-based model that allows for customized data queries through research questions or keywords (Query-by-Question), a visual design that helps users determine the availability of harmonized data for a given research question (Query-by-Condition), and the ability to reveal the underlying relational patterns among substantive and methodological variables in the database (Query-by-Relation), aiding in the rigorous evaluation or improvement of regression models. Case studies with multiple social scientists have demonstrated the usefulness and effectiveness of the SDR Querier in addressing daily challenges.more » « less
-
This special issue examines innovative methods in three areas of protest studies: (1) survey methodology and scaling, (2) the development and assessment of political event data, and (3) methods of contextual analysis. The articles provide new techniques and general methodologies for improving the quality of data that we have about protest, especially in the comparative study of protest.more » « less
-
Historically Black colleges and universities (HBCUs) are important for diversifying the science technology, engineering, and mathematics (STEM) workforce. This study aims to develop a scale to understand the experiences of HBCU STEM students to spur research on the factors associated with HBCUs’ success with recruiting, retaining, and graduating Black STEM students. Nearly 3,000 undergraduate STEM students across 30 HBCUs participated in this study. The authors conducted exploratory and confirmatory factor analysis to examine the construct validity. The survey had a seven-factor structure with a comparative fit index of 0.9 and high reliability with Cronbach’s alpha ranging from 0.68-0.91. Five factors significantly predicted student outcomes, indicating predictive validity. The resulting survey, HBCU Student STEM Success Survey, provides a reliable and valid measure for HBCU STEM students’ experiences.more » « less
An official website of the United States government

