Title: Circuit design in biology and machine learning. I. Random networks and dimensional reduction
Abstract A biological circuit is a neural or biochemical cascade, taking inputs and producing outputs. How have biological circuits learned to solve environmental challenges over the history of life? The answer certainly follows Dobzhansky’s famous quote that “nothing in biology makes sense except in the light of evolution.” But that quote leaves out the mechanistic basis by which natural selection’s trial-and-error learning happens, which is exactly what we have to understand. How does the learning process that designs biological circuits actually work? How much insight can we gain about the form and function of biological circuits by studying the processes that have made those circuits? Because life’s circuits must often solve the same problems as those faced by machine learning, such as environmental tracking, homeostatic control, dimensional reduction, or classification, we can begin by considering how machine learning designs computational circuits to solve problems. We can then ask: How much insight do those computational circuits provide about the design of biological circuits? How much does biology differ from computers in the particular circuit designs that it uses to solve problems? This article steps through two classic machine learning models to set the foundation for analyzing broad questions about the design of biological circuits. One insight is the surprising power of randomly connected networks. Another is the central role of internal models of the environment embedded within biological circuits, illustrated by a model of dimensional reduction and trend prediction. Overall, many challenges in biology have machine learning analogs, suggesting hypotheses about how biology’s circuits are designed.  more » « less
Award ID(s):
2325755
PAR ID:
10664441
Author(s) / Creator(s):
Publisher / Repository:
Oxford Univ Press
Date Published:
Journal Name:
Evolution
Volume:
79
Issue:
8
ISSN:
0014-3820
Page Range / eLocation ID:
1403 to 1418
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Anomaly detection is a well-established field in machine learning, identifying observations that deviate from typical patterns. The principles of anomaly detection could enhance our understanding of how biological systems recognize and respond to atypical environmental inputs. However, this approach has received limited attention in analyses of cellular and physiological circuits. This study builds on machine learning techniques—such as dimensionality reduction, boosted decision trees, and anomaly classification—to develop a conceptual framework for biological circuits. One problem is that machine learning circuits tend to be unrealistically large for use by cellular and physiological systems. I therefore focus on minimal circuits inspired by machine learning concepts, reduced to the cellular scale. Through illustrative models, I demonstrate that small circuits can provide useful classification of anomalies. The analysis also shows how principles from machine learning—such as temporal and atemporal anomaly detection, multivariate signal integration, and hierarchical decision-making cascades—can inform hypotheses about the design and evolution of cellular circuits. This interdisciplinary approach enhances our understanding of cellular circuits and highlights the universal nature of computational strategies across biological and artificial systems. 
    more » « less
  2. Quantum computers are a revolutionary class of computational platforms with applications in combinatorial and global optimization, machine learning, and other domains involving computationally hard problems. While these machines typically operate on qubits—quantum information elements that can occupy superpositions of the basis |0⟩ and |1⟩ states—recent advances have demonstrated the practical implementation of higher dimensional quantum systems (qudits) across various hardware platforms. In these hardware realizations, the higher order states are less stable, and thus remain coherent for a shorter duration than the basis |0⟩ and |1⟩ states. Moreover, formal methods for designing efficient encoder circuits for these systems remain underexplored. This limitation motivates the development of efficient circuit techniques for qudit systems (d-level quantum systems). Previous works have typically established generating gate sets for higher dimensional codes by generalizing the methods used for qubits. In this work, we introduce a systematic framework for optimizing encoder circuits for prime-dimension stabilizer codes. This framework is based on novel generating gate sets whose elements map directly to efficient Clifford gate sequences. We demonstrate the effectiveness of this method on key codes, achieving a 13% –44% reduction in encoder circuit gate count for the qutrit (d = 3) [[9,5,3]]3, [[5,1,3]]3, and [[7,1,3]]3 codes, and a 9% –21% reduction for the ququint (d = 5) [[10,6,3]]5 code when compared to prior work. We also achieved circuit depth reductions up to 42%. 
    more » « less
  3. Due to nucleic acid's programmability, it is possible to realize DNA structures with computing functions, and thus a new generation of molecular computers is evolving to solve biological and medical problems. Pioneered by Milan Stojanovic, Boolean DNA logic gates created the foundation for the development of DNA computers. Similar to electronic computers, the field is evolving towards integrating DNA logic gates and circuits by positioning them on substrates to increase circuit density and minimize gate distance and undesired crosstalk. In this minireview, we summarize recent developments in the integration of DNA logic gates into circuits localized on DNA substrates. This approach of all‐DNA integrated circuits (DNA ICs) offers the advantages of biocompatibility, increased circuit response, increased circuit density, reduced unit concentration, facilitated circuit isolation, and facilitated cell uptake. DNA ICs can face similar challenges as their equivalent circuits operating in bulk solution (bulk circuits), and new physical challenges inherent in spatial localization. We discuss possible avenues to overcome these obstacles. 
    more » « less
  4. Convolutional neural networks (CNN) are an emerging technique in modeling neural circuits and have been shown to converge to biologically plausible functionality in cortical circuits via task-optimization. This functionality has not been observed in CNN models of retinal circuits via task-optimization. We sought to observe this convergence in retinal circuits by designing a biologically inspired CNN model of a motion-detection retinal circuit and optimizing it to solve a motion-classification task. The learned weights and parameters indicated that the CNN converged to direction-sensitive ganglion and amacrine cells, cell types that have been observed in biology, and provided evidence that task-optimization is a fair method of building retinal models. The analysis used to understand the functionality of our CNN also indicates that biologically constrained deep learning models are easier to reason about their underlying mechanisms than traditional deep learning models. 
    more » « less
  5. Convolutional neural networks (CNN) are an emerging technique in modeling neural circuits and have been shown to converge to biologically plausible functionality in cortical circuits via task-optimization. This functionality has not been observed in CNN models of retinal circuits via task-optimization. We sought to observe this convergence in retinal circuits by designing a biologically inspired CNN model of a motion-detection retinal circuit and optimizing it to solve a motion-classification task. The learned weights and parameters indicated that the CNN converged to direction-sensitive ganglion and amacrine cells, cell types that have been observed in biology, and provided evidence that task-optimization is a fair method of building retinal models. The analysis used to understand the functionality of our CNN also indicates that biologically constrained deep learning models are easier to reason about their underlying mechanisms than traditional deep learning models. 
    more » « less