Title: Beyond Euclid: an illustrated guide to modern machine learning with geometric, topological, and algebraic structures
Abstract The enduring legacy of Euclidean geometry underpins classical machine learning, which, for decades, has been primarily developed for data lying in Euclidean space. Yet, modern machine learning increasingly encounters richly structured data that is inherently non-Euclidean. This data can exhibit intricate geometric, topological and algebraic structure: from the geometry of the curvature of space-time, to topologically complex interactions between neurons in the brain, to the algebraic transformations describing symmetries of physical systems. Extracting knowledge from such non-Euclidean data necessitates a broader mathematical perspective. Echoing the 19th-century revolutions that gave rise to non-Euclidean geometry, an emerging line of research is redefining modern machine learning with non-Euclidean structures. Its goal: generalizing classical methods to unconventional data types with geometry, topology, and algebra. In this review, we provide an accessible gateway to this fast-growing field and propose a graphical taxonomy that integrates recent advances into an intuitive unified framework. We subsequently extract insights into current challenges and highlight exciting opportunities for future development in this field.  more » « less
Award ID(s):
2134241 2313150 2240158
PAR ID:
10674541
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ;
Publisher / Repository:
Machine Learning for Science and Technology
Date Published:
Journal Name:
Machine Learning: Science and Technology
Volume:
6
Issue:
3
ISSN:
2632-2153
Page Range / eLocation ID:
031002
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. A<sc>bstract</sc> Motivated by engineering vector-like (Higgs) pairs in the spectrum of 4d F-theory compactifications, we combine machine learning and algebraic geometry techniques to analyze line bundle cohomologies on families of holomorphic curves. To quantify jumps of these cohomologies, we first generate 1.8 million pairs of line bundles and curves embedded indP3, for which we compute the cohomologies. A white-box machine learning approach trained on this data provides intuition for jumps due to curve splittings, which we use to construct additional vector-like Higgs-pairs in an F-Theory toy model. We also find that, in order to explain quantitatively the full dataset, further tools from algebraic geometry, in particular Brill-Noether theory, are required. Using these ingredients, we introduce a diagrammatic way to express cohomology jumps across the parameter space of each family of matter curves, which reflects a stratification of the F-theory complex structure moduli space in terms of the vector-like spectrum. Furthermore, these insights provide an algorithmically efficient way to estimate the possible cohomology dimensions across the entire parameter space. 
    more » « less
  2. The Johnson-Lindenstrauss (JL) lemma is a cornerstone of dimensionality reduction in Euclidean space, but its applicability to non-Euclidean data has remained limited. This paper extends the JL lemma beyond Euclidean geometry to handle general dissimilarity matrices that are prevalent in real-world applications. We present two complementary approaches: First, we show how the JL transform can be applied to vectors in pseudo-Euclidean space with signature , providing theoretical guarantees that depend on the ratio of the norm and Euclidean norm of two vectors, measuring the deviation from Euclidean geometry. Second, we prove that any symmetric hollow dissimilarity matrix can be represented as a matrix of generalized power distances, with an additional parameter representing the uncertainty level within the data. In this representation, applying the JL transform yields multiplicative approximation with a controlled additive error term proportional to the deviation from Euclidean geometry. Our theoretical results provide fine-grained performance analysis based on the degree to which the input data deviates from Euclidean geometry, making practical and meaningful reduction in dimensionality accessible to a wider class of data. We validate our approaches on both synthetic and real-world datasets, demonstrating the effectiveness of extending the JL lemma to non-Euclidean settings. 
    more » « less
  3. Abstract Single-cell RNA-seq data analysis seeks to characterize cellular heterogeneity based on high-dimensional gene expression profiles. Conventional approaches represent each cell as a vector in Euclidean space, which limits their ability to capture intrinsic correlations and multiscale geometric structures. We propose a multiscale framework based on Grassmann manifolds that integrates machine learning with subspace geometry for single-cell RNA-seq data analysis. By generating embeddings under multiple representation scales, the framework combines their features from different geometric views into a unified Grassmann manifold. A power-based scale sampling function is introduced to control the selection of scales and balance information across resolutions. Experiments on nine benchmark single-cell RNA-seq datasets demonstrate that the proposed approach effectively preserves meaningful structures and provides stable clustering performance, particularly for small to medium-sized datasets. These results suggest that Grassmann manifolds offer a coherent and informative foundation for analyzing single-cell RNA-seq data. 
    more » « less
  4. An excellent ring of prime characteristic for which the Frobenius map is pure is also Frobenius split in many commonly occurring situations in positive characteristic commutative algebra and algebraic geometry. However, using a fundamental construction from rigid geometry, we show that excellent $$F$$-pure rings of prime characteristic are not Frobenius split in general, even for Euclidean domains. Our construction uses the existence of a complete non-Archimedean field $$k$$ of characteristic $$p$$ with no nonzero continuous $$k$$-linear maps $$k^{1/p} \to k$$. An explicit example of such a field is given based on ideas of Gabber, and may be of independent interest. Our examples settle a long-standing open question in the theory of $$F$$-singularities whose origin can be traced back to when Hochster and Roberts introduced the notion of $$F$$-purity. The excellent Euclidean domains we construct also admit no nonzero $$R$$-linear maps $$R^{1/p} \rightarrow R$$. These are the first examples that illustrate that $$F$$-purity and Frobenius splitting define different classes of singularities for excellent domains, and are also the first examples of excellent domains with no nonzero $$p^{-1}$$-linear maps. The latter is particularly interesting from the perspective of the theory of test ideals. 
    more » « less
  5. Abstract We prove that the reconstruction of a certain type of length spaces from their travel time data on a closed subset is Lipschitz stable. The travel time data is the set of distance functions from the entire space, measured on the chosen closed subset. The case of a Riemannian manifold with boundary with the boundary as the measurement set appears is a classical geometric inverse problem arising from Gel’fand’s inverse boundary spectral problem. Examples of spaces satisfying our assumptions include some non-simple Riemannian manifolds, Euclidean domains with non-trivial topology, and metric trees. 
    more » « less