skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Metric to Quantify Subjective Information in Biological Gradient Sensing
Information theory has been successfully applied to biology with interesting results and applications, ranging from scientific discovery, to system modeling, and engineering. Novel concepts such as semantic and useful information have been proposed to address the peculiarity of biological systems in contrast to Shannon’s classical theory. In this paper, the concept of subjective information, previously observed as an emergent property in a simulated biological system with determinate char- acteristics, is further explored through the proposal of a novel metric for its quantification. This measure is based on a biological system’s ability to dynamically sense and react to environmental signals to achieve a goal. The novel metric is validated through the simulation of a computational model that enables its correlation with different strategies for information acquisition from the environment and processing. The obtained results indicate that the proposed measure of subjective information is reliable in quantifying the effectiveness of a biological system’s strategy in using information from the environment for its growth and survival.  more » « less
Award ID(s):
1816969
PAR ID:
10488362
Author(s) / Creator(s):
; ;
Publisher / Repository:
IEEE
Date Published:
Journal Name:
GLOBECOM 2023 - 2023 IEEE Global Communications Conference
Page Range / eLocation ID:
571-576
Subject(s) / Keyword(s):
Information theory, computational simulation of biological cells, chemical reception, mutual information, semantic information, chemotaxis
Format(s):
Medium: X
Location:
Rio de Janeiro, Brazil
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Information processing has increasingly gained traction as a unifying and holistic concept to characterize biological systems. Current research has obtained important but limited results in applying information to understanding life, mainly because of inherent syntactic constraints embedded in a universally accepted theory, formulated for communication system engineering, rather than a universal characterization of nature. In this paper, we further the notion of "subjective information", which takes into account the relative importance of different information sources for distinct life functions. To this end, we develop a computational model of a microorganism that requires two metabolic substrates to survive and grow. The substrates have different spatial distributions, and the organism acquires information on their environmental concentrations and gradients through a noisy receptor-binding process, ultimately guiding its chemotaxis in the environment to increase the chances of growth and survival. Our simulation results reveal a trade-off between a living system's capability to maximize the acquisition of information from the environment, and the maximization of its growth and survival over time, suggesting that a form of "subjective information" promotes growth and survival in life processes, rather than the classical, purely syntactic Shannon information. 
    more » « less
  2. Information transmission and storage have gained traction as unifying concepts to characterize biological systems and their chances of survival and evolution at multiple scales. Despite the potential for an information-based mathematical framework to offer new insights into life processes and ways to interact with and control them, the main legacy is that of Shannon’s, where a purely syntactic characterization of information scores systems on the basis of their maximum information efficiency. The latter metrics seem not entirely suitable for biological systems, where transmission and storage of different pieces of information (carrying different semantics) can result in different chances of survival. Based on an abstract mathematical model able to capture the parameters and behaviors of a population of single-celled organisms whose survival is correlated to information retrieval from the environment, this paper explores the aforementioned disconnect between classical information theory and biology. In this paper, we present a model, specified as a computational state machine, which is then utilized in a simulation framework constructed specifically to reveal emergence of a “subjective information”, i.e., trade-off between a living system’s capability to maximize the acquisition of information from the environment, and the maximization of its growth and survival over time. Simulations clearly show that a strategy that maximizes information efficiency results in a lower growth rate with respect to the strategy that gains less information but contains a higher meaning for survival. 
    more » « less
  3. It is difficult to achieve robust and well-generalized models for tasks involving subjective concepts such as emotion. It is inevitable to deal with noisy labels, given the ambiguous nature of human perception. Methodologies relying on semi-supervised learning (SSL) and curriculum learning have been proposed to enhance the generalization of the models. This study proposes a novel deep mutual information (DeepMI) metric, built with the SSL pre-trained DeepEmoCluster framework to establish the difficulty of samples. The DeepMI metric quantifies the relationship between the acoustic patterns and emotional attributes (e.g., arousal, valence, and dominance). The DeepMI metric provides a better curriculum, achieving state-of-the-art performance that is higher than results obtained with existing curriculum metrics for speech emotion recognition (SER). We evaluate the proposed method with three emotional datasets in matched and mismatched testing conditions. The experimental evaluations systematically show that a model trained with the DeepMI metric not only obtains competitive generalization performances, but also maintains convergence stability. Furthermore, the extracted DeepMI values are highly interpretable, reflecting information ranks of the training samples. 
    more » « less
  4. In this paper, we consider the problem of securely operating a cyber-physical system in an adversarial environment. The defending mechanism we introduce is proactive in nature and employs the principles of moving target defense. The defense implementation utilizes a switching structure to persistently and stochastically alter the behavior of the system with respect to both its actuators and its sensors. Thus, the ability of an adversary to successfully scan the system in preparation for the attack is decreased. The unpredictability of the system’s operation is quantified by an entropy metric which is subsequently optimized. Theorems are presented that show stability of the system under proactive switching. Simulations show the efficacy of the proposed approach on a simplified aircraft model. 
    more » « less
  5. Understanding cellular engagement with its environment is essential to control and monitor metabolism. Molecular Communication theory (MC) offers a computational means to identify environmental perturbations that direct or signify cellular behaviors by quantifying the information about a molecular environment that is transmitted through a metabolic system. We developed an model that integrates conventional flux balance analysis metabolic modeling (FBA) and MC to mechanistically expand the scope of MC, and thereby uniquely blends mechanistic biology and information theory to understand how substrate consumption is captured reaction activity, metabolite excretion, and biomass growth. This is enabled by defining several channels through which environmental information transmits in a metabolic network. The information flow in bits that is calculated through this workflow further determines the maximal metabolic effect of environmental perturbations on cellular metabolism and behaviors, since FBA simulates maximal efficiency of the metabolic system. We exemplify this method on two intestinal symbionts – Bacteroides thetaiotaomicron and Methanobrevibacter smithii – and visually consolidated the results into constellation diagrams that facilitate interpretation of information flow from given environments and thereby cultivate the design of controllable biological systems. The unique confluence of metabolic modeling and information theory in this model advances basic understanding of cellular metabolism and has applied value for the Internet of Bio-Nano Things, synthetic biology, microbial ecology, and autonomous laboratories. 
    more » « less