skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, January 16 until 2:00 AM ET on Friday, January 17 due to maintenance. We apologize for the inconvenience.


Title: Content Removal as a Moderation Strategy: Compliance and Other Outcomes in the ChangeMyView Community
Moderators of online communities often employ comment deletion as a tool. We ask here whether, beyond the positive effects of shielding a community from undesirable content, does comment removal actually cause the behavior of the comment’s author to improve? We examine this question in a particularly well-moderated community, the ChangeMyView subreddit. The standard analytic approach of interrupted time-series analysis unfortunately cannot answer this question of causality because it fails to distinguish the effect of having made a non-compliant comment from the effect of being subjected to moderator removal of that comment. We therefore leverage a “delayed feedback” approach based on the observation that some users may remain active between the time when they posted the non-compliant comment and the time when that comment is deleted. Applying this approach to such users, we reveal the causal role of comment deletion in reducing immediate noncompliance rates, although we do not find evidence of it having a causal role in inducing other behavior improvements. Our work thus empirically demonstrates both the promise and some potential limits of content removal as a positive moderation strategy, and points to future directions for identifying causal effects from observational data.  more » « less
Award ID(s):
1741441 1750615
PAR ID:
10113291
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the ACM on human-computer interaction
ISSN:
2573-0142
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Determining the best management practices for plant invasions is a critical, but often elusive goal. Invasive removals frequently involve complex and poorly understood biotic interactions. For example, invasive species can leave potent legacies that influence the success of native species restoration efforts, and positive plant‐microbial feedbacks may promote continued reinvasion by an exotic species following restoration. Removal methods can vary in their effects on plant–soil feedbacks, with consequences for restoration of native species. We determined the effects of invasion by a leguminous shrub (French broom;Genista monspessulana) on the density and community composition of, and benefit conferred by, its microbial mutualists in its invading range. Densities of soil‐dwelling rhizobia were much higher in areas invaded byG. monspessulanarelative to uninvaded areas, and this increased density of rhizobia fed back to increase seedling growth of both the invader and native legumes. We further compared how three techniques for removingG. monspessulanaaffected the densities of rhizobia relative to areas whereG. monspessulanawas still present. Removal by hand‐pulling reduced soil rhizobial densities, and reduced growth of one native legume, while having no effect on the growth of the invader. Overall, our results show that the consequences of restoration techniques, both above‐ and belowground, could be critical for the successful removal of an invasive legume and restoration of native species.

     
    more » « less
  2. Background

    When unaddressed, contamination in child maltreatment research, in which some proportion of children recruited for a nonmaltreated comparison group are exposed to maltreatment, downwardly biases the significance and magnitude of effect size estimates. This study extends previous contamination research by investigating how a dual‐measurement strategy of detecting and controlling contamination impacts causal effect size estimates of child behavior problems.

    Methods

    This study included 634 children from the LONGSCAN study with 63 cases of confirmed child maltreatment after age 8 and 571 cases without confirmed child maltreatment. Confirmed child maltreatment and internalizing and externalizing behaviors were recorded every 2 years between ages 4 and 16. Contamination in the nonmaltreated comparison group was identified and controlled by either a prospective self‐report assessment at ages 12, 14, and 16 or by a one‐time retrospective self‐report assessment at age 18. Synthetic control methods were used to establish causal effects and quantify the impact of contamination when it was not controlled, when it was controlled for by prospective self‐reports, and when it was controlled for by retrospective self‐reports.

    Results

    Rates of contamination ranged from 62% to 67%. Without controlling for contamination, causal effect size estimates for internalizing behaviors were not statistically significant. Causal effects only became statistically significant after controlling contamination identified from either prospective or retrospective reports and effect sizes increased by between 17% and 54%. Controlling contamination had a smaller impact on effect size increases for externalizing behaviors but did produce a statistically significant overall effect, relative to the model ignoring contamination, when prospective methods were used.

    Conclusions

    The presence of contamination in a nonmaltreated comparison group can underestimate the magnitude and statistical significance of causal effect size estimates, especially when investigating internalizing behavior problems. Addressing contamination can facilitate the replication of results across studies.

     
    more » « less
  3. Abstract

    Instrumental variables have been widely used to estimate the causal effect of a treatment on an outcome. Existing confidence intervals for causal effects based on instrumental variables assume that all of the putative instrumental variables are valid; a valid instrumental variable is a variable that affects the outcome only by affecting the treatment and is not related to unmeasured confounders. However, in practice, some of the putative instrumental variables are likely to be invalid. This paper presents two tools to conduct valid inference and tests in the presence of invalid instruments. First, we propose a simple and general approach to construct confidence intervals based on taking unions of well‐known confidence intervals. Second, we propose a novel test for the null causal effect based on a collider bias. Our two proposals outperform traditional instrumental variable confidence intervals when invalid instruments are present and can also be used as a sensitivity analysis when there is concern that instrumental variables assumptions are violated. The new approach is applied to a Mendelian randomization study on the causal effect of low‐density lipoprotein on globulin levels.

     
    more » « less
  4. Abstract

    The spatial habitat heterogeneity hypothesis posits that habitat complexity increases the abundance and diversity of species. In tropical forests, lianas add substantial habitat heterogeneity and complexity throughout the vertical forest profile, which may maintain animal abundance and diversity. The effects of lianas on tropical animal communities, however, remain poorly understood. We propose that lianas have a positive effect on animals by enhancing habitat complexity. Lianas may have a particularly strong influence on the forest bird community, providing nesting substrate, protection from predators, and nutrition (food). Understory insectivorous birds, which forage for insects that specialize on lianas, may particularly benefit. Alternatively, it is possible that lianas have a negative effect on forest birds by increasing predator abundances and providing arboreal predators with travel routes with easy access to bird nests. We tested the spatial habitat heterogeneity hypothesis on bird abundance and diversity by removing lianas, thus reducing forest complexity, using a large‐scale experimental approach in a lowland tropical forest in the Republic of Panama. We found that removing lianas decreased total bird abundance by 78.4% and diversity by 77.4% after 8 months, and by 40.0% and 51.7%, respectively, after 20 months. Insectivorous bird abundance and diversity 8 months after liana removal were 91.8% and 89.5% lower, respectively, indicating that lianas positively influence insectivorous birds. The effects of liana removal persisted longer for insectivorous birds than other birds, with 77.3% lower abundance and 76.2% lower diversity after 20 months. Liana removal also altered bird community composition, creating two distinct communities in the control and removal plots, with disproportionate effects on insectivores. Our findings demonstrate that lianas have a strong positive influence on the bird community, particularly for insectivorous birds in the forest understory. Lianas may maintain bird abundance and diversity by increasing habitat complexity, habitat heterogeneity, and resource availability.

     
    more » « less
  5. Edward N. Zalta & Uri Nodelman (Ed.)
    This entry discusses some accounts of causal explanation developed after approximately 1990. Our focus in this entry is on the following three accounts – Section 1 those that focus on mechanisms and mechanistic explanations, Section 2 the kairetic account of explanation, and Section 3 interventionist accounts of causal explanation. All of these have as their target explanations of why or perhaps how some phenomenon occurs (in contrast to, say, explanations of what something is, which is generally taken to be non-causal) and they attempt to capture causal explanations that aim at such explananda. Section 4 then takes up some recent proposals having to do with how causal explanations may differ in explanatory depth or goodness. Section 5 discusses some issues having to do with what is distinctive about causal (as opposed to non-causal) explanations. 
    more » « less