Physical samples and their associated data and metadata underpin scientific discoveries across disciplines and can enable new science when appropriately archived. However, there are significant gaps in current practices and infrastructure that prevent accurate provenance tracking, reproducibility, and attribution. For most samples, descriptive metadata are often sparse, inaccessible, or absent. Samples and associated data and metadata may also be scattered across numerous physical collections, data repositories, laboratories, data files, and papers with no clear linkage or provenance tracking as new information is generated over time. The Earth Science Information Partners (ESIP) Physical Samples Curation Cluster has therefore developed guidance for scientific authors on ‘Publishing Open Research Using Physical Samples.’ This involved synthesizing existing practices, gathering community feedback, and assessing real-world examples. We identified improvements needed to enable authors to efficiently cite and link Earth science samples and related data, and track their use. Our goal is to help improve discoverability, interoperability, and reuse of physical samples, and associated data and metadata. Though primarily focused on the needs of Earth and environmental sciences, these guidelines are broadly applicable.
more »
« less
Automated Metadata Enhancement for Physical Sample Record Aggregation in the iSamples Project
Large amounts of samples have been collected and stored by different institutions and collections across the world. However, even the most carefully curated collections can appear incomplete when aggregated. To solve this problem and support the increasing multidisciplinary science conducted on these samples, we propose a method to support the FAIRness of the aggregation by augmenting the metadata of source records. Using a pipeline that is a combination of rule‐based and machine learning‐based procedures, we predict the missing values of the metadata fields of 4,388,514 samples. We use these inferred fields in our user interface to improve the reusability.
more »
« less
- Award ID(s):
- 2004562
- PAR ID:
- 10531420
- Publisher / Repository:
- Wiley
- Date Published:
- Journal Name:
- Proceedings of the Association for Information Science and Technology
- Volume:
- 60
- Issue:
- 1
- ISSN:
- 2373-9231
- Page Range / eLocation ID:
- 1131 to 1133
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)The Tweet Collection Management (TWT) Team aims to ingest 5 billion tweets, clean this data, analyze the metadata present, extract key information, classify tweets into categories, and finally, index these tweets into Elasticsearch to browse and query. The main deliverable of this project is a running software application for searching tweets and for viewing Twitter collections from Digital Library Research Laboratory (DLRL) event archive projects. As a starting point, we focused on two development goals: (1) hashtag-based and (2) username-based search for tweets. For IR1, we completed extraction of two fields within our sample collection: hashtags and username. Sample code for TwiRole, a user-classification program, was investigated for use in our project. We were able to sample from multiple collections of tweets, spanning topics like COVID-19 and hurricanes. Initial work encompassed using a sample collection, provided via Google Drive. An NFS-based persistent storage was later involved to allow access to larger collections. In total, we have developed 9 services to extract key information like username, hashtags, geo-location, and keywords from tweets. We have also developed services to allow for parsing and cleaning of raw API data, and backup of data in an Apache Parquet filestore. All services are Dockerized and added to the GitLab Container Registry. The services are deployed in the CS cloud cluster to integrate services into the full search engine workflow. A service is created to convert WARC files to JSON for reading archive files into the application. Unit testing of services is complete and end-to-end tests have been conducted to improve system robustness and avoid failure during deployment. The TWT team has indexed 3,200 tweets into the Elasticsearch index. Future work could involve parallelization of the extraction of metadata, an alternative feature-flag approach, advanced geo-location inference, and adoption of the DMI-TCAT format. Key deliverables include a data body that allows for search, sort, filter, and visualization of raw tweet collections and metadata analysis; a running software application for searching tweets and for viewing Twitter collections from Digital Library Research Laboratory (DLRL) event archive projects; and a user guide to assist those using the system.more » « less
-
This dataset contains a complete export of all iSamples records as of April 21, 2025, in GeoParquet format. The dataset includes over 6.6 million sample records with rich metadata including geographic coordinates, material classifications, context categories, and related resources. The data was exported using the iSamples export client with the query 'source:*', capturing the complete state of the iSample.xyz repository. Each record includes sample identifiers, descriptions, classifications, geospatial information (using WGS 84 coordinate system), timestamps, and various categorical attributes. This GeoParquet file provides an efficient format for analyzing the global distribution and classification of physical samples across scientific domains. The dataset is valuable for researchers working with physical samples in geoscience, material science, biology, and related fields who need to discover, access, or analyze sample collections at scale.more » « less
-
ABSTRACT Optimal preservation of tissues from the field to long‐term cryo‐storage is paramount to securing genetic resources for research needs. DNA preservation techniques vary, with flash freezing currently considered the gold standard in tissue preservation. However, flash freezing tissue samples in the field presents challenges, necessitating a more comprehensive understanding of the quantity and quality of preserved DNA from different techniques in archival collections. We compared metrics from DNA extractions from field‐collected amphibian, squamate and bird tissues from archival collections that were flash‐frozen in liquid nitrogen or fixed in either ethanol or tissue lysis buffer prior to archival cryopreservation. We also included DNA extracted from tissues of known liquid nitrogen tank failures to provide a baseline of DNA degradation under the very worst‐case scenario. Flash‐frozen tissues often preserved higher yields of DNA, but peak fragment size, the percentage of fragments larger than 10 kb and DNA integrity numbers were all significantly reduced compared to tissues first preserved in fixative buffers. This pattern was observed across independent samples and between flash‐frozen and buffer‐preserved pair replicates. Degradation seen in flash‐frozen tissues was also distinct to tissues from known tank failures. We suggest that degradation in flash‐frozen tissues occurred during shipping, sample sorting/accession or during subsequent subsampling when tissues may partially or fully thaw, exposing DNA to damaging freeze–thaw processes. By contrast, tissues in fixative buffers were likely protected from freeze–thaw damage. This study highlights that using multiple field preservation methods and minimising freeze–thaw cycles for flash‐frozen tissues may provide the most robust protection against the DNA degradation sources encountered by field collections.more » « less
-
Abstract Groundwater/surface‐water (GW/SW) exchange and hyporheic processes are topics receiving increasing attention from the hydrologic community. Hydraulic, chemical, temperature, geophysical, and remote sensing methods are used to achieve various goals (e.g., inference of GW/SW exchange, mapping of bed materials, etc.), but the application of these methods is constrained by site conditions such as water depth, specific conductance, bed material, and other factors. Researchers and environmental professionals working on GW/SW problems come from diverse fields and rarely have expertise in all available field methods; hence there is a need for guidance to design field campaigns and select methods that both contribute to study goals and are likely to work under site‐specific conditions. Here, we present the spreadsheet‐based GW/SW‐Method Selection Tool (GW/SW‐MST) to help practitioners identify methods for use in GW/SW and hyporheic studies. The GW/SW‐MST is a Microsoft Excel‐based decision support tool in which the user selects answers to questions about GW/SW‐related study goals and site parameters and characteristics. Based on user input, the tool indicates which methods from a toolbox of 32 methods could potentially contribute to achieving the specified goals at the site described.more » « less
An official website of the United States government

