Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Authors’ attitude toward adopting a new workflow to improve the computability of phenotype publications
Abstract Critical to answering large-scale questions in biology is the integration of knowledge from different disciplines into a coherent, computable whole. Controlled vocabularies such as ontologies represent a clear path toward this goal. Using survey questionnaires, we examined the attitudes of biologists toward adopting controlled vocabularies in phenotype publications. Our questions cover current experience and overall attitude with controlled vocabularies, the awareness of the issues around ambiguity and inconsistency in phenotype descriptions and post-publication professional data curation, the preferred solutions and the effort and desired rewards for adopting a new authoring workflow. Results suggest that although the existence of controlled vocabularies is widespread, their use is not common. A majority of respondents (74%) are frustrated with ambiguity in phenotypic descriptions, and there is a strong agreement (mean agreement score 4.21 out of 5) that author curation would better reflect the original meaning of phenotype data. Moreover, the vast majority (85%) of researchers would try a new authoring workflow if resultant data were more consistent and less ambiguous. Even more respondents (93%) suggested that they would try and possibly adopt a new authoring workflow if it required 5% additional effort as compared to normal, but higher rates resulted in a steep decline in likely adoption rates. Among the four different types of rewards, two types of citations were the most desired incentives for authors to produce computable data. Overall, our results suggest the adoption of a new authoring workflow would be accelerated by a user-friendly and efficient software-authoring tool, an increased awareness of the challenges text ambiguity creates for external curators and an elevated appreciation of the benefits of controlled vocabularies.  more » « less
Award ID(s):
1661485
PAR ID:
10339235
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Database
Volume:
2022
ISSN:
1758-0463
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; (, Biodiversity Data Journal)
    Phenotypes are used for a multitude of purposes such as defining species, reconstructing phylogenies, diagnosing diseases or improving crop and animal productivity, but most of this phenotypic data is published in free-text narratives that are not computable. This means that the complex relationship between the genome, the environment and phenotypes is largely inaccessible to analysis and important questions related to the evolution of organisms, their diseases or their response to climate change cannot be fully addressed. It takes great effort to manually convert free-text narratives to a computable format before they can be used in large-scale analyses. We argue that this manual curation approach is not a sustainable solution to produce computable phenotypic data for three reasons: 1) it does not scale to all of biodiversity; 2) it does not stop the publication of free-text phenotypes that will continue to need manual curation in the future and, most importantly, 3) It does not solve the problem of inter-curator variation (curators interpret/convert a phenotype differently from each other). Our empirical studies have shown that inter-curator variation is as high as 40% even within a single project. With this level of variation, it is difficult to imagine that data integrated from multiple curation projects can be of high quality. The key causes of this variation have been identified as semantic vagueness in original phenotype descriptions and difficulties in using standardised vocabularies (ontologies). We argue that the authors describing phenotypes are the key to the solution. Given the right tools and appropriate attribution, the authors should be in charge of developing a project’s semantics and ontology. This will speed up ontology development and improve the semantic clarity of phenotype descriptions from the moment of publication. A proof of concept project on this idea was funded by NSF ABI in July 2017. We seek readers input or critique of the proposed approaches to help achieve community-based computable phenotype data production in the near future. Results from this project will be accessible through https://biosemantics.github.io/author-driven-production. 
    more » « less
  2. ; ; ; ; ; ; ; ; (, Biodiversity Information Science and Standards)
    It takes great effort to manually or semi-automatically convert free-text phenotype narratives (e.g., morphological descriptions in taxonomic works) to a computable format before they can be used in large-scale analyses. We argue that neither a manual curation approach nor an information extraction approach based on machine learning is a sustainable solution to produce computable phenotypic data that are FAIR (Findable, Accessible, Interoperable, Reusable) (Wilkinson et al. 2016). This is because these approaches do not scale to all biodiversity, and they do not stop the publication of free-text phenotypes that would need post-publication curation. In addition, both manual and machine learning approaches face great challenges: the problem of inter-curator variation (curators interpret/convert a phenotype differently from each other) in manual curation, and keywords to ontology concept translation in automated information extraction, make it difficult for either approach to produce data that are truly FAIR. Our empirical studies show that inter-curator variation in translating phenotype characters to Entity-Quality statements (Mabee et al. 2007) is as high as 40% even within a single project. With this level of variation, curated data integrated from multiple curation projects may still not be FAIR. The key causes of this variation have been identified as semantic vagueness in original phenotype descriptions and difficulties in using standardized vocabularies (ontologies). We argue that the authors describing characters are the key to the solution. Given the right tools and appropriate attribution, the authors should be in charge of developing a project's semantics and ontology. This will speed up ontology development and improve the semantic clarity of the descriptions from the moment of publication. In this presentation, we will introduce the Platform for Author-Driven Computable Data and Ontology Production for Taxonomists, which consists of three components: a web-based, ontology-aware software application called 'Character Recorder,' which features a spreadsheet as the data entry platform and provides authors with the flexibility of using their preferred terminology in recording characters for a set of specimens (this application also facilitates semantic clarity and consistency across species descriptions); a set of services that produce RDF graph data, collects terms added by authors, detects potential conflicts between terms, dispatches conflicts to the third component and updates the ontology with resolutions; and an Android mobile application, 'Conflict Resolver,' which displays ontological conflicts and accepts solutions proposed by multiple experts. a web-based, ontology-aware software application called 'Character Recorder,' which features a spreadsheet as the data entry platform and provides authors with the flexibility of using their preferred terminology in recording characters for a set of specimens (this application also facilitates semantic clarity and consistency across species descriptions); a set of services that produce RDF graph data, collects terms added by authors, detects potential conflicts between terms, dispatches conflicts to the third component and updates the ontology with resolutions; and an Android mobile application, 'Conflict Resolver,' which displays ontological conflicts and accepts solutions proposed by multiple experts. Fig. 1 shows the system diagram of the platform. The presentation will consist of: a report on the findings from a recent survey of 90+ participants on the need for a tool like Character Recorder; a methods section that describes how we provide semantics to an existing vocabulary of quantitative characters through a set of properties that explain where and how a measurement (e.g., length of perigynium beak) is taken. We also report on how a custom color palette of RGB values obtained from real specimens or high-quality specimen images, can be used to help authors choose standardized color descriptions for plant specimens; and a software demonstration, where we show how Character Recorder and Conflict Resolver can work together to construct both human-readable descriptions and RDF graphs using morphological data derived from species in the plant genus Carex (sedges). The key difference of this system from other ontology-aware systems is that authors can directly add needed terms to the ontology as they wish and can update their data according to ontology updates. a report on the findings from a recent survey of 90+ participants on the need for a tool like Character Recorder; a methods section that describes how we provide semantics to an existing vocabulary of quantitative characters through a set of properties that explain where and how a measurement (e.g., length of perigynium beak) is taken. We also report on how a custom color palette of RGB values obtained from real specimens or high-quality specimen images, can be used to help authors choose standardized color descriptions for plant specimens; and a software demonstration, where we show how Character Recorder and Conflict Resolver can work together to construct both human-readable descriptions and RDF graphs using morphological data derived from species in the plant genus Carex (sedges). The key difference of this system from other ontology-aware systems is that authors can directly add needed terms to the ontology as they wish and can update their data according to ontology updates. The software modules currently incorporated in Character Recorder and Conflict Resolver have undergone formal usability studies. We are actively recruiting Carex experts to participate in a 3-day usability study of the entire system of the Platform for Author-Driven Computable Data and Ontology Production for Taxonomists. Participants will use the platform to record 100 characters about one Carex species. In addition to usability data, we will collect the terms that participants submit to the underlying ontology and the data related to conflict resolution. Such data allow us to examine the types and the quantities of logical conflicts that may result from the terms added by the users and to use Discrete Event Simulation models to understand if and how term additions and conflict resolutions converge. We look forward to a discussion on how the tools (Character Recorder is online at http://shark.sbs.arizona.edu/chrecorder/public) described in our presentation can contribute to producing and publishing FAIR data in taxonomic studies. 
    more » « less
  3. ; ; ; (, ACM)
    Despite decades of research on the effectiveness of Peer Instruction (PI), it can be hard to convince computing instructors to try it. In Peer Instruction an instructor displays a hard multiple-choice question during lecture, students answer individually, discuss with peers, and answer independently again. The main reasons computing instructors give for not adopting PI is a lack of awareness, concerns that it would result in less coverage of material in lecture, and the time needed to adopt it. We tried to increase awareness of PI and address instructors' concerns during a three-day summer instructor workshop with 14 instructors in 2024. A pre-survey was administered on the first day of the workshop and a post-survey on the last day. We administered a second post-survey in the fall of 2024. Later semi-structured interviews were conducted with nine instructors. The adoption rate from the 2024 workshop was over 50%, which was much higher than the previous two workshop's adoption rate of 23%. The workshop also increased knowledge of PI and alleviated several concerns. However, instructors wanted more follow-up support, an easier and faster way to create new PI questions, and better integration with their Learning Management System (LMS). Instructors who adopted the free tool, Peer+, reported positive student reactions and better understanding of student misconceptions. All instructors who adopted Peer+ plan to continue to use it. 
    more » « less
  4. ; ; ; (, Association for Computing Machinery)
    Yuen, Timothy T; Joshi, Deepti; Prather, James; Fouh, Eric; Kiesler, Natalie (Ed.)
    Despite decades of research on the effectiveness of Peer Instruction (PI), it can be hard to convince computing instructors to try it. In Peer Instruction an instructor displays a hard multiple-choice question during lecture, students answer individually, discuss with peers, and answer independently again. The main reasons computing instructors give for not adopting PI is a lack of awareness, concerns that it would result in less coverage of material in lecture, and the time needed to adopt it. We tried to increase awareness of PI and address instructors' concerns during a three-day summer instructor workshop with 14 instructors in 2024. A pre-survey was administered on the first day of the workshop and a post-survey on the last day. We administered a second post-survey in the fall of 2024. Later semi-structured interviews were conducted with nine instructors. The adoption rate from the 2024 workshop was over 50%, which was much higher than the previous two workshop's adoption rate of 23%. The workshop also increased knowledge of PI and alleviated several concerns. However, instructors wanted more follow-up support, an easier and faster way to create new PI questions, and better integration with their Learning Management System (LMS). Instructors who adopted the free tool, Peer+, reported positive student reactions and better understanding of student misconceptions. All instructors who adopted Peer+ plan to continue to use it. 
    more » « less
  5. ; ; ; ; ; (, Transportation Research Record: Journal of the Transportation Research Board)
    null (Ed.)
    Earthquakes along the Cascadia subduction zone would generate a local tsunami that could arrive at coastlines within minutes. Few studies provide empirical evidence to understand the potential behaviors of local residents during this emergency. To fill this knowledge gap, this study examines residents’ perceptions and intended evacuation behaviors in response to an earthquake and tsunami, utilizing a survey sent to households in Seaside, OR. The results show that the majority of respondents can correctly identify whether their house is inside or outside a tsunami inundation zone. Older respondents are more likely to identify this correctly regardless of any previous disaster evacuation experience or community tenure. The majority of respondents (69%) say they would evacuate in the event of a tsunami. Factors influencing this choice include age, motor ability, access to transportation, and trust in infrastructure resiliency or traffic conditions. While the City of Seaside actively promotes evacuation by foot, 38% of respondents still state they would use a motor vehicle to evacuate. Females and older respondents are more likely to evacuate by foot. Respondents with both higher confidence in their knowledge of disaster evacuation and higher income are more likely to indicate less time needed to evacuate than others. Generally, respondents are more likely to lead rather than follow during an evacuation, especially respondents who report being more prepared for an evacuation and who have a higher perceived risk. This study showcases a unique effort at empirically analyzing human tsunami evacuation lead or follow choice behavior. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Text Encoded Conversion
  • XML
  • Save / Share this Record
  • Send to Email