<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Gaussian process regression as a surrogate model for the computation of dispersion relations</title></titleStmt>
			<publicationStmt>
				<publisher>Elsevier</publisher>
				<date>02/01/2024</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10569173</idno>
					<idno type="doi">10.1016/j.cma.2023.116661</idno>
					<title level='j'>Computer Methods in Applied Mechanics and Engineering</title>
<idno>0045-7825</idno>
<biblScope unit="volume">420</biblScope>
<biblScope unit="issue">C</biblScope>					

					<author>Alexander C Ogren</author><author>Berthy T Feng</author><author>Katherine L Bouman</author><author>Chiara Daraio</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[The ability to design materials for wave propagation behaviors has high potential for impact in medical imaging, telecommunications, and signal processing. The dispersion relation is the key mathematical object that describes linear elastic wave propagation behavior in a material. To date, the design of wave propagation behavior in materials has been limited to one or two design objectives, for example, designing for one or two bandgaps or wavespeeds. This is a result of the complicated relationship between a material and its dispersion relation, and the hefty computational cost of traditional dispersion computations. Decreasing the amount of time required to perform dispersion computations will streamline the design process of wave devices, allowing for more thorough design optimization workflows, more highly resolved design features, and multi-functional materials.In this work, we demonstrate a specialized Gaussian Process Regressor as a surrogate model for the computation of dispersion relations to alleviate the immense computational cost of the traditional model. By measuring covariance information from relatively small training sets (10s to 1000s of dispersion relations), our surrogate model efficiently infers the full dispersion ω Corresponding author.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.">Introduction</head><p>The structure and constitution of a material dictate the properties of the waves it can support, which are thoroughly described by the material's dispersion relation. A material's dispersion relation is the relationship between the frequencies and wavevectors of all linear elastic waves that can travel in the material. Dispersion relations contain information about bandgaps (frequencies at which waves experience spatial attenuation), group velocity (the velocity with which energy can be transported by waves in the material), and phase velocity (the velocity at which a wave peak will move in the material). Bandgap information can be leveraged to engineer filtering and reflection, and group velocity and phase velocity information can be leveraged to achieve refraction. These fundamental behaviors can in turn be utilized to design complex wave propagation devices such as wave guides <ref type="bibr">[1]</ref><ref type="bibr">[2]</ref><ref type="bibr">[3]</ref>, wave lenses <ref type="bibr">[4]</ref><ref type="bibr">[5]</ref><ref type="bibr">[6]</ref>, wave multiplexers <ref type="bibr">[1,</ref><ref type="bibr">2,</ref><ref type="bibr">7]</ref>, and more.</p><p>Current methods to calculate dispersion relations are based on numerically computing the eigenvalues of the elastic wave equation <ref type="bibr">[8]</ref>. Computational limitations are especially restrictive when these expensive forward models are used to solve the inverse problem of design <ref type="bibr">[9]</ref><ref type="bibr">[10]</ref><ref type="bibr">[11]</ref><ref type="bibr">[12]</ref><ref type="bibr">[13]</ref>. As a result, scientists and engineers are often forced to simplify design workflows by limiting the design space to be relatively narrow, considering only partial dispersion information and/or relatively basic design objectives <ref type="bibr">[1,</ref><ref type="bibr">2,</ref><ref type="bibr">4,</ref><ref type="bibr">9,</ref><ref type="bibr">[12]</ref><ref type="bibr">[13]</ref><ref type="bibr">[14]</ref>.</p><p>Our method aims to increase the accessibility of full dispersion relations to alleviate the need for simplifications such as partial dispersion computations. Full dispersion relations are defined over a region of reciprocal space (wavevector space) called the irreducible Brillouin zone (IBZ). Due to computational costs, dispersion relations are often computed only along one-dimensional slices of these regions called irreducible Brillouin zone contours (IBZ contours). However it has been recently shown that using this simplification can lead to errors <ref type="bibr">[15]</ref>. Further, plane symmetry groups without mirror symmetries do not have a uniquely defined IBZ contour. For unit cells belonging to these plane symmetry groups, dispersion analysis along a contour will yield different results depending arbitrarily on the choice of contour. As a second example, a common shortcut when designing for group velocity is to compute the dispersion relation at only a handful of wavevectors or frequencies of interest. This is useful for achieving desired wave behavior in specific directions of propagation <ref type="bibr">[12]</ref>, or at specific frequencies of interest <ref type="bibr">[14]</ref>. Although these methods are sufficient for designing simple wave devices, the design of next-generation, multi-functional wave devices will require the efficient computation of full dispersion relations.</p><p>Techniques have been developed specifically to efficiently solve dispersion problems such as Bloch mode synthesis <ref type="bibr">[16,</ref><ref type="bibr">17]</ref>, spectral X-FEM <ref type="bibr">[18]</ref>, specialized mixed-variational formulations <ref type="bibr">[19]</ref>, reduced Bloch mode expansion <ref type="bibr">[20]</ref>, reduced Bloch operator finite element methods <ref type="bibr">[21]</ref>, and wave finite element methods (WFEM) <ref type="bibr">[22,</ref><ref type="bibr">23]</ref>. However, even these specially tailored methods executed by a highly parallelized and optimized implementation on a multi-CPU multi-GPU cluster admit the need for more efficient ways to explore the design space <ref type="bibr">[13]</ref>. To perform design optimization on a 48 3 voxel domain, a distributed computing setup using 16 NVIDIA GTX-780 GPUs takes 6.5 min per optimization iteration, even when computing the dispersion relation only along the IBZ contour rather than over the full IBZ <ref type="bibr">[13]</ref>. Fundamentally, each of <ref type="bibr">[16]</ref><ref type="bibr">[17]</ref><ref type="bibr">[18]</ref><ref type="bibr">[19]</ref><ref type="bibr">[20]</ref><ref type="bibr">[21]</ref><ref type="bibr">[22]</ref><ref type="bibr">[23]</ref> reduces the cost of dispersion computations by reducing the number of effective degrees of freedom involved in the model, thereby reducing the size of the eigenvalue problem that needs to be solved at each wavevector point. In contrast, our surrogate model reduces the total number of eigenvalue problems that need to be solved. Due to this construction, our surrogate model can seamlessly integrate with any of these aforementioned techniques to produce an efficiency improvement that compounds with that of the physics-based technique being paired with our model. Surrogate models, often involving machine learning, have been proposed in a variety of settings to reduce the computational cost of purely physics-based methods. The applications range from multi-scale modeling <ref type="bibr">[24]</ref><ref type="bibr">[25]</ref><ref type="bibr">[26]</ref><ref type="bibr">[27]</ref>, to dynamics <ref type="bibr">[28]</ref>, statics <ref type="bibr">[29]</ref>, turbulence <ref type="bibr">[30]</ref>, optics <ref type="bibr">[31]</ref>, and many others. For dispersion relation computations specifically, a fixed-resolution convolutional neural network (CNN) surrogate model has been proposed <ref type="bibr">[32]</ref>. This CNN model is shown to vastly outperform the traditional densely connected neural network, suggesting that the convolutional architecture is more appropriate for these types of problems. Because CNNs can make predictions so quickly once the model is trained, it seems like a very attractive option. However, neural networks often require large amounts of training data, which are expensive to compute (hundreds of thousands of precomputed dispersion relations <ref type="bibr">[32]</ref>) and require a lengthy training period (13 min on a GPU reported just for the 1D problem <ref type="bibr">[32]</ref>). Unless the trained model is subsequently used to make predictions for more dispersion relations than were included in the training set, the time used to generate the training data outweighs the time saved by using the model. Further, the CNNs architecture locks the user into a fixed unit cell resolution and fixed dispersion relation resolution. If a user desires to change the resolution of the discretization of the unit cell or IBZ, a new model architecture needs to be trained on a new training set with the corresponding resolution. Recently, there has been a push towards surrogate models that exhibit resolution independence, meaning that the model can train on data of one spatio-temporal resolution, and make predictions at another resolution <ref type="bibr">[33]</ref><ref type="bibr">[34]</ref><ref type="bibr">[35]</ref>. In the spirit of this effort, the surrogate model we propose exhibits resolution independence both in terms of unit cell discretization and IBZ discretization.</p><p>We propose using Gaussian process regression <ref type="bibr">[36]</ref> to obtain principled surrogate models of full dispersion relations. In particular, we propose a data-driven covariance function that only requires a small training set of dispersion relations (tens to thousands) and allows for an efficient acquisition function. In comparison to deep learning-based surrogate models, our model achieves higher accuracy with less training data and is invariant to unit cell representation.</p><p>The key features of our model are:</p><p>1. The model is independent of unit cell representation. For example, if the model learned covariance information from a dataset of parametrically defined unit cells, it can still be used to make predictions for pixelated designs, and vice versa. 2. The model requires a relatively low amount (tens to thousands) of training data samples to make accurate predictions. The model learns from data by measuring covariance information, which takes less than 20 s even for reasonably large training set sizes. 3. The model uses a physics-based method to sample the dispersion relation at various points in the IBZ. This physics-based method is a modular component of the model that can be swapped for other, faster physics-based methods for dispersion computations. Because of this, the efficiency gains provided by our model directly augment the efficiency gains of the physics-based model. 4. The model not only supplies predictions, but also offers uncertainty estimates. 5. The model is differentiable, allowing for its use in gradient-based topology optimization.</p><p>In this paper, we first discuss the traditional methods currently used for the computation of dispersion relations and gradientbased optimization of dispersion relations. We then go on to provide a brief overview of Gaussian process regression (GPR). Next, we describe the details of our model and demonstrate how it would be applied to one-dimensional problems. Finally, we apply our model to two-dimensional unit cells and evaluate its performance against traditional methods as well as another existing surrogate model.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.">Traditional computation of dispersion relations</head><p>To compute the dispersion relation of a periodic structured material, the physical domain of analysis is reduced to a single unit cell. The frequency domain dynamics of linear-elastic periodic solids are governed by the harmonic elastic wave equation with Bloch-Floquet periodic boundary conditions. The harmonic elastic wave equation looks for wave mode solutions that obey linear elasticity, and assumes that these solutions will be temporally sinusoidal. The Bloch-Floquet boundary conditions enforce that the solution is periodic (since the domain is periodic), but with a complex phase offset. The complex phase offset is used to make sure we are finding modal wave solutions with a variety of different wavelengths (not just wavelengths that are integer divisors of the unit cell's dimensions).</p><p>The harmonic elastic wave equation in &#120596; dimensions is</p><p>and the Bloch-Floquet periodic boundary conditions are</p><p>The density, &#120576;(&#120599;), and the material stiffness tensor, &#120597; &#120589;&#120571;&#8501;&#8502; (&#120599;), define the linear-elastic material properties of the unit cell, 0. The wavevector, &#8882;, and the eigenfrequency, &#120603;, inversely describe the length and time scales of the wave. The displacement field, &#120602;(&#120599;), describes the vibrational mode by which the wave travels. Finally, the lattice vectors, &#8503; &#8504; , define the lattice of the periodic material, and &#120538; is the imaginary unit. The equation is a generalized eigenvalue problem with &#120602;(&#120599;) and &#120603; 2 as the eigenvector and eigenvalue respectively. To compute the dispersion relation, the eigenvalues of this equation must be determined as a function of &#8882;, &#977;&#8882; &#982; 1 (letting 1 denote the irreducible Brillouin zone).</p><p>With the exception of a few simple cases, analytical solutions for dispersion relations are not obtainable. For this reason, numerical solutions are often used to discretize the generalized eigenvalue problem (Eq. ( <ref type="formula">1</ref>)). Although there are many numerical methods to compute dispersion relations, one of the most well-known (though not necessarily the most efficient) is the Finite Element Method. Within the framework of FEM, the dispersion relation can be computed by assembling the stiffness and mass matrices, 2(&#8882;), and 3(&#8882;), and solving the generalized eigenvalue problem for each &#8882; in a discretization of the IBZ:</p><p>There are several other specially tailored methods that have been shown to be more efficient than the finite element method when solving this particular PDE <ref type="bibr">[16]</ref><ref type="bibr">[17]</ref><ref type="bibr">[18]</ref><ref type="bibr">[19]</ref><ref type="bibr">[20]</ref><ref type="bibr">[21]</ref><ref type="bibr">[22]</ref><ref type="bibr">[23]</ref>. We note that the surrogate model we have developed can be used in conjunction with any of these more highly-specialized methods.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.">Traditional gradient-based optimization of dispersion relations</head><p>Gradient-based optimization is a powerful design tool that can be used in many contexts (including wave propagation <ref type="bibr">[9,</ref><ref type="bibr">12,</ref><ref type="bibr">13]</ref>) to obtain material designs that exhibit desired behaviors. Designs are represented by a design vector, 4, containing parameter values that uniquely determine the geometry and constitutive properties of the unit cell design. The goal of design optimization is to determine a 4 that results in the desired wave behavior, often achieved by maximizing or minimizing an objective function (which encodes design objectives) via gradient-based methods. To use these gradient-based methods, gradients of the objective function are needed, which in turn depend on gradients of quantities embedded in the dispersion relation. In this section, we quickly step through a few known equations commonly used in optimization problems surrounding wave behavior. In this context, 2 and 3 are not only functions of the wavevector, but also of the design vector, 4. Derivations of these equations can be found in Appendix C.</p><p>To modify the frequency, &#120603;, at a specific wavevector by incrementally changing the design variable, the following sensitivity equation is useful. Assume all eigenvectors are normalized by the mass matrix; i.e., &#120602; &#969; 3&#120602; = 1 where (&#8923;) &#969; denotes conjugate transpose. For ease of reading, assume here that 4 is a scalar. These equations can easily be extended to vector 4 by repeating the following computations for each entry of 4. The gradient of one frequency in the dispersion relation with respect the design variable is given by</p><p>To modify the group velocity, &#120593;&#120603; &#120593;&#8882; , at a specific wavevector, the sensitivity computation is more complicated and more computationally expensive. The group velocity can be computed analytically by</p><p>The design sensitivity of the group velocity can be computed analytically by</p><p>where 5 = &#120593;2 &#120593;&#8882; &#949; &#120603; 2 &#120593;3 &#120593;&#8882; , and &#120593;&#120602; &#120593;4 can be computed by solving the linear system:</p><p>)</p><p>)</p><p>Not only is it computationally expensive to compute dispersion relations, but it is also computationally expensive to compute the design sensitivities of dispersion relations. Lu et al. report sensitivity analysis accounting for nearly half the time consumed by one iteration of optimization <ref type="bibr">[13]</ref>. Later, we will explain how our surrogate model gives multiple options for computing sensitivities, opening the possibility for further computational savings. We also provide explicit equations for how to compute these gradients when using the surrogate model.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.">Gaussian process regression</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1.">Overview</head><p>Gaussian process regression (GPR) is a probabilistic regression method that constructs a predictive distribution for an unknown function, 7 (&#120599;), by combining observations of the function with prior information <ref type="bibr">[36]</ref>. Because the function is unknown, we think of 7 (&#120599;) as being a random function distributed according to a Gaussian process &#8753;&#8754;(8(&#120599;), &#8501;(&#120599;, &#120599; &#1009; )) defined by mean function 8(&#120599;) and covariance function &#8501;(&#120599;, &#120599; &#1009; ).</p><p>Evaluation of this function at any finite number of points is described by a joint Gaussian distribution. Let 8 and &#8501; operate row-wise when given matrix input, with 8(9) yielding the mean vector corresponding to the points indicated by the rows of 9, and &#8501;(9, 9 &#1009; ) yielding the covariance matrix for the points in 9 and 9 &#1009; . With matrix 9 &#969; and vector 7 &#969; denoting the set of points for which we would like to make evaluations, the prior distribution is</p><p>where &#8755; denotes a normal distribution. Given a dataset . = {(&#120599; &#120589; , , &#120589; )}, &#120589; = 7 (&#120599; &#120589; ) + &lt;, &lt; &#962; &#8755; (0, &#8463; 2 7 )} &gt; &#120589;=1 of (possibly noisy) observations of 7 (&#120599;), the predictive distribution is formed by conditioning the prior distribution on the observations. With 9 and , denoting the observations, and &#8902; denoting the identity matrix, the predictive distribution is</p><p>Numerically, Eq. ( <ref type="formula">10</ref>) is often implemented in two steps. The first step is to find the model weights, &#8808;, which are independent of the prediction locations, by solving the linear system in Eq. <ref type="bibr">(11)</ref>. Subsequently, predictions can be made at arbitrary locations 9 &#969; using the pre-computed model weights &#8808; in Eq. ( <ref type="formula">10</ref>) rather than solving the system anew.</p><p>Because GPR yields a predictive distribution, we not only infer a prediction as the mean of the distribution, but also a measure of uncertainty as the variance of the distribution.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.2.">Eigenfunction analysis of the covariance function</head><p>In later sections, we perform eigenfunction analysis of our proposed covariance function. Eigenfunction analysis is often used to assess the convergence and expressive power of a Gaussian process regressor. A function &#119860;(&#120599;) is an eigenfunction of the covariance function &#8501;(&#120599;, &#120599; &#1009; ) with eigenvalue &#119861;, with respect to measure 6(&#120599;) if it satisfies</p><p>These eigenfunctions form a basis which spans the space of all possible functions that can be attained by the mean function of the Gaussian process regressor, which is called the hypothesis space. A Gaussian process regressor can exactly represent any function in the span of the eigenfunctions with nonzero eigenvalues. A covariance function with an infinite number of nonzero eigenvalues is said to be nondegenerate, while one with only a finite number of nonzero eigenvalues is said to be degenerate.</p><p>A Gaussian process regressor with a nondegenerate covariance function has almost unlimited expressive power since its hypothesis space is the span of an infinite eigenbasis. In the limit of infinite observations, the model can exactly fit any function that can be represented by the generalized fourier series &#8969; &#8711; &#120589;=1 &#8503; &#120589; &#119860; &#120589; (&#120599;). In other words, for a GP regressor with a nondegenerate covariance function, the posterior mean function will converge to the expected value of the true underlying distribution as the number of observations goes to infinity (assuming the true underlying distribution is reasonably well-behaved).</p><p>In contrast, a Gaussian process regressor with a degenerate covariance function has limited expressive power, since its eigenfunctions span only a finite dimensional hypothesis space. For a GP regressor with a degenerate covariance function, in the limit of infinite observations, the posterior mean function will instead converge to the best 6-weighted &#119863; 2 approximation of the expected value of the true underlying distribution within the span of the eigenfunctions. Practically, this means that although a Gaussian process regressor with a degenerate covariance function may not converge to the exact solution in the limit of infinite regression points, it can still make a highly accurate prediction if its eigenbasis is comprehensive enough for the desired application.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.">Methods</head><p>In this section, we give the specifics of our surrogate model, and demonstrate its application to relatively simple one-dimensional dispersion computations. This toy problem is meant only to serve as an example -the substance of our results can be found in the following section. Traditional dispersion computations require the solution of an eigenvalue problem at each wavevector in a discretization of the irreducible Brillouin zone (IBZ). The goal of our surrogate model is to predict the eigenvalue solutions for each wavevector after solving the eigenvalue problems at only a small subset of these wavevectors. For most unit cells, which have many physical degrees of freedom, it is common in dispersion analysis to only consider the smallest &gt; eigenvalues. In our surrogate model framework, we use &gt; separate GPR models to fit the &gt; eigenvalue bands, {&#120603; &#120589; (&#8882;)} &gt; &#120589;=1 . The structures used in this section for demonstration are periodic one-dimensional bars. They can only transmit waves along their axis and have relatively simple dispersion relations. We randomly generate unit cell designs which have smoothly varying constitutive properties, except at randomly selected interfaces where the property values are allowed to be discontinuous (details in Appendix A.1). These interfaces lead to wave scattering behavior in the material -a mechanism well-known to cause band gaps in the dispersion relation. Examples of these unit cells and their dispersion relations are shown below in Fig. <ref type="figure">1</ref>. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.1.">Mean function</head><p>Our model uses a zero mean function (8(&#120599;) = 0). This is common in GPR, and does not mean that the predictive distribution will have a zero mean. Nonzero mean functions are often used when the function to be fit has an underlying trend that can be written explicitly (such as a signal that, on average, increases linearly with time but has unpredictable variations around that average). Because dispersion relations have no such trends that can be explicitly written, we leave our mean function as zero. This leaves the entirety of the model's capacity to be carried by the covariance function.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.2.">Covariance function</head><p>The covariance function is usually the most crucial component in any Gaussian process model because it encodes the statistical coupling between function values at each point in the domain, defining underlying patterns and relationships in the data. Often, Gaussian process models use simple isotropic covariance functions such as the squared exponential or the Mat&#233;rn covariance functions. Isotropic covariance functions are functions only of the distance between points in input space, meaning that they can only encode assumptions about the underlying function globally. These functions offer a convenient starting point for basic applications of Gaussian process modeling; however, they lack the expressiveness that can be offered by more thoughtful constructions of the covariance function. We propose a non-isotropic covariance function that encodes richer covariance information in a principled way that varies throughout the domain.</p><p>Our surrogate model uses a dataset of precomputed dispersion relations to construct its covariance function. Given a dataset &#119864; = {(&#8882;, &#120603;) &#120589; } of dispersion relations evaluated at a fixed set of wavevectors 1 &#119864; , we measure the covariance between the frequency values at all pairs of wavevectors in 1 &#119864; . This covariance computation is extremely fast, especially when compared to the training process of neural networks. For example, to compute the covariance matrix for 10,000 dispersion relations with 10,000 points evaluated in each dispersion relation, only 6 s on a 9th generation Intel Core i7-9750H are required. Once the covariance matrix is computed, we use cubic interpolation of the measured covariance values to define the covariance function, &#8501; &#8706; 1 &#119865; -1 &#119866; &#57774; R &#119865;-&#119866; mapping any two lists of wavevectors to the appropriate covariance matrix. Each eigenvalue band is described by its own separate covariance function. Although this data-driven covariance function is degenerate (i.e., in the limit of infinite regression points, the estimated dispersion relation converges to the best solution spanned by the finite eigenbasis rather than the exact numerical solution), it achieves higher accuracy than a data-agnostic covariance function given a limited number of regression points. Convergence to the exact numerical solution is not necessary in practical design problems, since even the exact solution does not perfectly represent real-world physics.</p><p>To demonstrate how this works for the one-dimensional case, we compute the covariance between frequency values at each pair of wavenumbers for the dataset shown in the right-most panel of Fig. <ref type="figure">1</ref>. The results of this computation are shown in Fig. <ref type="figure">2</ref>. For this demonstration, the dataset is small, with only 5 dispersion relations, and coarse, with the domain discretized into only 10 points. Even so, we can see that we have already captured critical information about the type of function we are trying to fit. For example, we see that the variance is 0 at &#8882; = 0, and that the frequency at this wavenumber has no covariance with the frequencies at any other wavenumber. This makes sense because, for the first eigenvalue band, this frequency is always zero, representing a rigid body mode, regardless of the rest of the dispersion relation. Conversely, the variance is maximum at &#8882; = &#119867;, and the frequency at this wavenumber is covariant with the frequency at many other wavenumbers, especially those nearby. In later sections, when working with 2D structures, there are two wavevector components to consider. In these cases, the covariance function should be thought of as a continuous scalar-valued function of four scalar variables, and covariance interpolation must happen in this four-dimensional space. Regardless, for all computational operations other than interpolation, standard matrix operations can still be applied after reshaping the four-dimensional covariance array into a matrix.</p><p>With the covariance and mean functions defined, our Gaussian process prior is defined. We can visualize our prior by sampling it. With the exception that the samples are allowed to assume negative values, they have characteristics similar to the dispersion bands (see the first panel of Fig. <ref type="figure">3</ref>). This shows that our covariance function yields a prior that encodes an appropriate hypothesis space, even before sampling any regression points.</p><p>A.C. Ogren et al.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.3.">Acquisition function</head><p>To fit the model to a specific dispersion relation, we supply it with a set of points (regression points) sampled from that dispersion relation. Because each regression point has a computational cost, it is beneficial to try to minimize the number of regression points needed, and maximize the information that each regression point contributes. An acquisition function is a function that tells the model how to select the locations of regression points. Here, we propose a greedy acquisition function that sequentially determines the most informative next point to sample. The acquisition function we have constructed uses the covariance function to evaluate the posterior variance over a discretization of the IBZ. The variance can be computed by evaluating the diagonal entries of the posterior covariance, &#120597; &#119865;&#119868;&#119869;&#119870;&#8883;&#119871;&#120589;&#119868;&#119871; , given by</p><p>where 1 &#969; are the wavevectors constituting the discretization of the IBZ, 1 . are the wavevectors representing the locations of the optimal regression points, and &#8902; denoting the identity matrix.</p><p>Starting with no regression points (1 . is empty, and the entire second term is zero), we consider the wavevector in 1 &#969; with the highest variance to be the most informative next wavevector to sample, so it becomes the next regression point location. We append this wavevector to 1 . , re-evaluate &#120597; &#119865;&#119868;&#119869;&#119870;&#8883;&#119871;&#120589;&#119868;&#119871; , and repeat. This process can be iterated until a desired number of regression point locations is obtained.</p><p>When this process is finished, 1 . represents an ordered list of optimal regression points. During the fitting process (described in Section 5.4), subsets of 1 . can be selected by taking the first &gt; elements if the computational budget does not permit the solution of the phononic eigenvalue problem for every wavevector in 1 . . Because our covariance function is degenerate, there is a finite limit on the number of regression points that can be effectively used by the model, and 1 . will not be able to grow beyond this size (the inversion in Eq. ( <ref type="formula">13</ref>) will run into conditioning issues). This limit can be quite large, and depends on the size and resolution of the dataset that was used to construct the covariance function.</p><p>Conveniently, our acquisition function is entirely independent of the observed values of the regression points. This means the locations (wavevectors) of the optimal regression points can be determined ahead of time without actually making observations of the regression points themselves, allowing for the parallel computation of regression point values (frequencies) later. Additionally, this means that the final 1 . is dependent only on the covariance function, and does not change as a function of the specific dispersion relation that the model is being fit to.</p><p>We visualize how our acquisition function works for a simple one-dimensional problem in the bottom row of panels of Fig. <ref type="figure">3</ref>. Without performing eigenvalue computations, we iteratively evaluate the posterior variance, and append the point of maximum variance to the ordered list of regression points. Fig. <ref type="figure">3</ref>. Top row: samples generated from the posterior (predictive) distribution with 0, 1, 2, and 10 regression points sampled (note that when 0 points are sampled, the posterior is the prior). As more points are sampled, the posterior distribution becomes much tighter, as can be seen by the decrease in variation of samples drawn from the posterior distribution. Bottom row: the variance of the posterior distribution with 0, 1 2, and 10 points sampled. The first three panels of the bottom row demonstrate the first three sequential steps of the algorithm used to determine the order in which points are sampled.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.4.">Fitting the model</head><p>With the mean, covariance, and acquisition functions determined, we can fit the GP model to a specific dispersion relation. To fit the model, we supply it with a set of regression points sampled from that dispersion relation. Our acquisition function determines the locations (wavevectors) of these points ahead of time. To perform the fit, we need to observe the eigenfrequency solutions associated with these wavevectors by solving the corresponding eigenvalue problem. Because the locations of the regression points have been determined ahead of time, these computations can be done in parallel. After observing regression points (1 . , &#119872; . ), we compute the model weights &#8808; by solving the linear system</p><p>where 1 . and &#119872; . are the wavevectors and frequencies of the regression points, &#8463; 2 &#120603; is the assumed variance of the noise on the regression point measurements, and &#8902; is the identity matrix. Because our regression points are generated by a well-chosen finite element model, it is reasonable to assume values of &#8463; 2 &#120603; as low as 0, if assuming the eigenvalue solutions are exact, or 10 &#949;16 to represent the uncertainty associated with using double precision floating point data format. We find that using &#8463; 2 &#120603; = 0 works well for our purposes, and does not produce significantly different behavior from using &#8463; 2 &#120603; = 10 &#949;16 . Once the model is fit to the regression points, the predictive distribution can be computed (Eq. ( <ref type="formula">15</ref>)). Because the predictive distribution is Gaussian, the maximum a posteriori estimate of the full dispersion relation is the mean of the predictive distribution. Further, the diagonal of the covariance matrix of the predictive distribution is the variance of each point being predicted. The variance gives us a metric for the model's predictive uncertainty at each wavevector in 1 &#969; . The predictive distribution is</p><p>where 1 &#969; are the wavevectors at which we would like to predict the frequency values of the dispersion band, and &#119872; &#969; are the predicted frequencies. In the top row of Fig. <ref type="figure">3</ref>, we draw samples from this predictive distribution to show its evolution as more regression points are used. When fewer regression points are used, the predictive distribution is quite broad, indicating uncertainty in the prediction. However, as more regression points are used, the predictive distribution becomes extremely tight, indicating much more certainty.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.5.">Gradients for gradient-based optimization</head><p>So far, we have detailed how to make predictions with our model. However, to use our model in gradient-based design optimization, we must be able to supply efficient design sensitivity computations. In this subsection, we describe how to compute gradients for frequency optimization and group velocity optimization.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.5.1.">Gradients for frequency optimization</head><p>Typically, computing the design sensitivity of the frequency at one wavevector requires not only the eigenvalue solution, but also the eigenvector solution (Eq. ( <ref type="formula">4</ref>)). However, our model predicts only the eigenvalue, not the eigenvector. There are at least two ways to amend this.</p><p>First, we could simply use the surrogate model to infer the dispersion relation, and use this inference to determine the wavevector at which we need to optimize the frequency. Then we could solve the eigenvalue problem corresponding to that single wavevector, and compute the design sensitivity using Eq. ( <ref type="formula">4</ref>). This is a great option if we only need to compute the design sensitivity of the frequency at a single wavevector, but do not know a priori at which wavevector (e.g. for bandgap optimization).</p><p>Alternatively, if the eigenvalue problems are particularly expensive, or if there are many wavevectors at which we desire to optimize the frequency, we can use a trick to avoid solving more eigenvalue problems. By employing the chain rule we can compute the gradient of any set of frequencies without performing additional eigenvalue computations. To do this, we first compute the gradient of the frequency at any wavevector with respect to the frequencies measured at the regression points. This gradient is defined by the GPR model. Then, since we do know the eigenvector at the regression points, we compute the gradient of the frequency at the regression point with respect to the design variables. This second gradient is defined by Eq. ( <ref type="formula">4</ref>). We then multiply these two quantities to obtain the design sensitivity of any frequencies we are interested in optimizing. That is,</p><p>where</p><p>and</p><p>where &#119873; . is a matrix containing the eigenvectors of the regression points, (&#8923;) &#969; denotes conjugate transpose, and the colon subscript indicates every element along the corresponding axis of the array (e.g. (&#119873; . ) &#8706;,&#120589; represents the &#120589;th column of &#119873; . ). Note that although this method does not require further eigenvalue solutions, it does require traditional sensitivity computations for a potentially large number of regression points. In practice, these two costs should be weighed against each other.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.5.2.">Gradients for group velocity optimization</head><p>Frequency is not the only subject of dispersion optimization. Group velocity is also a common optimization objective <ref type="bibr">[12]</ref>. Computing the design sensitivity of group velocity again requires eigenvector information at the wavevector of interest. It should be noted that traditional sensitivity computations for group velocities are more expensive than traditional sensitivity computations for frequencies because they require solving an extra system of equations. As with frequency optimization, there are two methods that we can use which will be advantageous in different situations.</p><p>First, we can use the surrogate model to infer the dispersion relation, and identify a wavevector of interest. Then we can solve the eigenvalue problem at that wavevector, and use Eqs. ( <ref type="formula">6</ref>), <ref type="bibr">(7)</ref> to compute the group velocity design sensitivities.</p><p>Alternatively, we can avoid group velocity sensitivity computations altogether by employing the chain rule. Using the surrogate model, the analytical expression for the predicted group velocity, &#119874; &#969; , is</p><p>where &#119875; is the gradient of the covariance function with respect to its first input. Since the covariance function is fixed, this can be estimated numerically once, and stored for further use. Subsequently, we apply the chain rule to write the sensitivity of the predicted group velocity with respect to the design variables:</p><p>where</p><p>and</p><p>&#120593;4 is again given by Eq. ( <ref type="formula">18</ref>). Using the second method requires traditional frequency sensitivity computations for a potentially large number of regression points. However, it gracefully avoids the need for any traditional group velocity sensitivity computations, which require solving a rather large linear system. This second method is advantageous to use when we desire to optimize group velocity at a large number of wavevector points.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.">Results</head><p>In this section, we apply our surrogate model to dispersion relations of two-dimensional materials and evaluate its performance against traditional methods and an existing deep-learning-based surrogate model.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.1.">Two-dimensional dispersion relations</head><p>When modeling materials in two dimensions, the evaluation of the dispersion relation becomes more complicated and more computationally costly than in one dimension. This is for two reasons. First, a two-dimensional material requires more degrees of freedom to be accurately modeled. Second, wave propagation in a 2-D material must be described by a wavevector, rather than a wavenumber, since wave propagation may occur in any combination of the two directions. This means that one must sweep over a 2-D parameter space of wavevectors, solving an eigenvalue problem at each point in this 2-D space. These issues are further exacerbated when working with 3-D materials.</p><p>For this reason, when considering 2-D and 3-D materials, engineers and scientists often evaluate the dispersion relation only on the IBZ contour or a ''virtual IBZ contour'' rather than the full IBZ. The definition of the IBZ contour is dependent on the symmetries of the unit cell, and is defined as the boundary of the IBZ for symmetry groups with reflection or glide-reflection symmetries. For symmetry groups without reflection or glide-reflection symmetries, the IBZ contour is not defined since the IBZ can be arbitrarily rotated, giving an infinite number of possible choices for the IBZ contour, and an infinite number of possible resulting dispersion band diagrams.</p><p>For example, Fig. <ref type="figure">4</ref> shows a unit cell lacking symmetry. Unit cells lacking symmetry belong to the &#119865;1 plane symmetry group (or wallpaper group). The IBZs of unit cells in the &#119865;1 symmetry group can be rotated arbitrarily, so a unique IBZ contour is not defined. As a substitute, the authors of <ref type="bibr">[15]</ref> use a ''virtual IBZ contour''. Although the construction of this contour is entirely artificial, we include it because many people in the acoustics and phononics field are accustomed to seeing dispersion information in this format. Even for unit cells that have well-defined IBZ contours, the commonly used contour shortcut yields only partial information about wave propagation through the medium. The goal of our surrogate model is to increase the accessibility of dispersion information over the full IBZ.</p><p>In Fig. <ref type="figure">4</ref>, we show the unit cell along with the first three bands of its dispersion relation evaluated along the ''virtual IBZ contour'', and over the full IBZ. We also show the inference of the surrogate model over these domains. ). The side length of the unit cell is &#8503; = .01 m. This unit cell has no symmetry, making it part of symmetry group &#119865;1 <ref type="bibr">[15]</ref>. The IBZ of this symmetry group can be arbitrarily rotated, so a well-defined IBZ contour does not exist <ref type="bibr">[15]</ref>. However, since so many are accustomed to visualizing dispersion information in this format, we have included the dispersion relation evaluated on the ''virtual IBZ contour'' as defined in <ref type="bibr">[15]</ref>. Here, we again show the true dispersion relation along with the inferred dispersion relation. (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article.)</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.2.">Generating random designs</head><p>In this section, we consider 2D unit cell designs of the &#119865;1 symmetry group (i.e. no symmetry) using a plane stress model. To generate random unit cell designs, we sample a Gaussian process with a 2-D periodic covariance function. To construct this covariance function, we start with a 1-D periodic covariance function,</p><p>where &#8463; 7 controls the overall variance of the Gaussian process, &#8925; controls the lengthscale of the randomness, and &#119865; is the period.</p><p>In our case, we set &#119865; to be the side length, &#8503;, of the unit cell. We form the 2-D periodic covariance function as the product of the 1-D periodic covariance function applied to each direction:</p><p>where &#120599; and , are the horizontal and vertical coordinates of locations in the unit cell. We emphasize that the Gaussian process used to generate unit cell designs has no direct connection with the Gaussian process used by the surrogate model for inference. Beyond the periodic covariance parameters (which control the variance and the lengthscale of features in the unit cell), there are several other parameters that define the unit cell. The lattice parameter &#8503; dictates the side length of the square unit cell. The resolution of the unit cell is determined by the integer &gt; &#119865;&#120589;&#120599; , which defines the number of pixels both vertically and horizontally. The constitutive properties of each pixel are bounded by &#119878; 8&#120589;&#8504; , &#119878; 8&#8503;&#120599; , &#120576; 8&#120589;&#8504; , &#120576; 8&#8503;&#120599; , &#119879; 8&#120589;&#8504; , and &#119879; 8&#8503;&#120599; , corresponding to elastic modulus, mass density, and Poisson's ratio respectively. The number of unique materials in each design is controlled by &gt; 8&#8503;&#119870; (for example, a bimaterial unit cell would be defined by &gt; 8&#8503;&#119870; = 2). Further details of unit cell design generation are given in Appendix A.2. Examples of how these unit cells might look are provided in Section 6.6.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.3.">Visualization of the acquisition function for the two-dimensional problem</head><p>In this section, we visualize the covariance and acquisition functions for the two-dimensional problem. In Fig. <ref type="figure">5</ref>, we show the evolution of the acquisition function and the resulting variance fields for a covariance function constructed from a dataset of 2000 dispersion relations. <ref type="foot">1</ref> As we compute the order of regression point sampling, we can observe that points that are not near to each other can be highly covariant. For example, the covariance function is taking advantage of the periodicity of the dispersion relation. In the example shown in Fig. <ref type="figure">5</ref>, the unit cells in the dataset used to construct the covariance function belong to the p1 plane symmetry group (they have no symmetry), which is a superset of all other plane symmetry groups. Due to the construction of this symmetry group's IBZ and the periodicity of the dispersion relation, the solution along the boundary of the IBZ must be symmetric across the line &#8882; &#120599; = 0. Indeed, we see from the (1, 1) and (2, 1) panels that a single regression point on the far left side of the IBZ causes a ''cold spot'' in the variance field on the right side of the IBZ in the region that is ''close'' to the regression point when considering the periodicity of the dispersion surface. This indicates that the model gains insight about the function value on the right side of the domain from information observed on the left. Our covariance function is able to implicitly learn crucial patterns such as periodicity and symmetry from the data, without the need for a user to manually encode these assumptions. Note that when the model uses 0 regression points, the posterior distribution is identical to the prior distribution. Also, we observe that as more regression points are used, the samples become more similar to each other, and to the true dispersion relation in the right column. Further, note that the posterior mean function is the final hypothesis of the surrogate model, not a randomly drawn posterior sample.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.4.">Inference examples</head><p>We now show examples of our surrogate model infering the dispersion relation for two-dimensional structures using a sparse set of regression points in Fig. <ref type="figure">6</ref>. In each case, the model uses a dataset of 2000 dispersion relations (the same dataset used to generate Fig. <ref type="figure">5</ref>) and 50 regression points (the same regression points shown in the bottom left panel of 5). The dataset was constructed with the following parameters: &#8463; 7 = 1, &#8925; = 0.5, &#8503; = 1 m, &gt; &#119865;&#120589;&#120599; = 16, &gt; 8&#8503;&#119870; = 2, &#119878; 8&#120589;&#8504; = 200 MPa, &#119878; 8&#8503;&#120599; = 200 GPa, &#120576; 8&#120589;&#8504; = 800 kg+m 3 , &#120576; 8&#8503;&#120599; = 8000 kg+m 3 , &#119879; 8&#120589;&#8504; = 0, &#119879; 8&#8503;&#120599; = 0.5. The wavevector resolution of each dispersion relation in the dataset is 101 -51. In Fig. <ref type="figure">6</ref> we use 50 regression points to achieve a relatively accurate prediction; however, in practice, the number of regression points can be adjusted fluidly to strike the right balance of accuracy versus computational cost depending on the application.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.5.">Eigenanalysis of the covariance function</head><p>In this section, to examine the relationship between the size of the covariance function training set and the expressivity of the model, we examine the spectra of covariance functions based on datasets of different sizes. Recall from Section 4.2 that the number of nonzero eigenvalues of the covariance function corresponds to the size of the covariance function's eigenbasis, which is the basis the model uses to fit to the regression points. A covariance function with a more comprehensive eigenbasis results in a model with more expressive power, and a model that can make use of a larger number of regression points.</p><p>For a range of logarithmically spaced dataset sizes, we compute the spectrum of the corresponding covariance function, and plot the spectra in Fig. <ref type="figure">7</ref>. As the size of the dataset increases, the number of nonzero eigenvalues increases, meaning that the covariance function's eigenbasis is expanding to be more expressive. Eventually, however, the addition of more dispersion relations to the dataset has a decreasing effect on the spectrum of the covariance function. For the largest dataset size (20,000 dispersion relations) we plot the eigenfunctions corresponding to the 10 largest eigenvalues of the covariance function in Fig. <ref type="figure">8</ref>. These eigenfunctions  Because we plot in log scale, eigenvalues that are zero are not plotted. As expected from basic statistics, we observe that datasets with larger numbers of dispersion relations produce covariance matrices with more nonzero eigenvalues. This indicates that covariance functions generated from larger datasets will have larger eigenbases, and therefore have more expressive power. However, we observe that the change in spectrum appears to slow down at some point, and we get diminishing returns after about 1700 dispersion relations. We can expect this ''saturation'' effect to happen at different points in different scenarios, and will depend on many factors including the resolution of the dispersion relations in the datasets and the method of generating unit cell designs. are the first ten elements of the eigenbasis, and can be thought of as the ten most prominent and fundamental function shapes that the model uses to fit a dispersion relation.</p><p>The expressivity of the model (i.e. the broadness of the hypothesis space) depends on the dataset used to construct the covariance function. In general, larger datasets will allow for more expressivity. This is not surprising, since other data-driven methods such as neural networks require larger amounts of data to characterize more complex functions. However, there is a difference in how the model complexity is determined. For a neural network, the hypothesis space is determined by the network architecture, which is typically determined before training the model. If too little training data is supplied, the hypothesis space of the network remains large, but the model's performance will be low since the training data was not sufficient to narrow down the hypothesis space. In contrast, the expressivity of our model's data-driven covariance function is determined by the dataset itself. With our method of covariance function construction, a small dataset will automatically result in a smaller hypothesis space, and a larger dataset will automatically result in a larger hypothesis space, without the need to adjust complicated model hyperparameters (such as network architecture).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.6.">Model evaluation</head><p>In the following subsections, we compare the performance of the GPR model against two other models in the context of the twodimensional problem. The first model is linear interpolation, representing the traditional model for computing dispersion relations. <ref type="foot">2</ref>The second model is an existing convolutional neural network surrogate model from the literature <ref type="bibr">[32]</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.6.1.">The datasets</head><p>To evaluate the performance of the GPR model, we consider the accuracy of the model as a function of the size of the covariance training set and the number of regression points for both in-distribution and out-of-distribution scenarios. We generate three datasets, one for training the covariance function, one for testing in-distribution performance, and one for testing out-of-distribution performance. The training dataset contains dispersion relations of 5000 unit cells generated as described in Section 6.  </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.6.2.">Performance metrics</head><p>To measure the error of the model, we use the &#119863; 2 norm and the &#119880; 1 norm, defined in Eqs. <ref type="bibr">(24)</ref>, <ref type="bibr">(25)</ref>. The &#119863; 2 norm allows us to assess how well the model infers frequency values, and the &#119880; 1 norm to assess how well the model infers group velocity values. Errors are evaluated at the resolution of the test sets, which are about five times more resolved along each of the two wavevector directions, as described in Section 6.6.1. After evaluating model error on each eigenvalue band of each dispersion relation in the test set, we average over eigenvalue bands, and take the 0.95 quantile over dispersion relations to get a sense for worst-case error. The norms are given as</p><p>where &#120593; &#8808; denotes the multi-index partial differential operator, }&#8808;} = &#8969; &#120589; &#8808; &#120589; , and &#120596; is some domain over which we are interested in measuring the function. In our case, &#120596; will be the IBZ, and the function 7 will be the error of the model.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.6.3.">Comparison against linear interpolation model</head><p>To compare against the linear interpolation model, we consider the number of regression points used by each model and the error that each model incurs in its prediction. In this subsection, because of the 1000shift in elastic modulus of the out-of-distribution test set, we divide the out-of-distribution errors by &#10217; 1000 so that they can be readily compared to the in-distribution errors. 3 We find that the GPR model always uses fewer regression points than the corresponding linear interpolation model achieving the same accuracy. At most, in this particular study, the GPR model uses 7.75 times fewer regression points than the equivalent linear interpolation model. Because almost all of the computational cost is due to regression point eigenvalue computations, this can be seen as a speed up of approximately the same factor. The results are shown below in Fig. <ref type="figure">10</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Fig. 10.</head><p>A comparison of the GPR model against the traditional linear interpolation model. Performance is evaluated on two datasets: in-distribution and outof-distribution. In both cases, the GPR model performs substantially better than the linear interpolation model. In the &#119880; 1 plot for in-distribution performance, the GPR model is shown to achieve the same error as the linear interpolation model while using up to 7.75fewer regression points.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.6.4.">Comparison against existing CNN surrogate model</head><p>We compare our model performance to the performance of the CNN surrogate model proposed by Finol et al. <ref type="bibr">[32]</ref>. Please refer to Appendix B for details about the CNN architecture and training. Note that the CNN uses the material properties of the unit cell in the input array. This is in contrast to the GPR model, which does not directly observe the material properties of the unit cell, but instead observes regression points of the dispersion relation.</p><p>In this subsection, we allow the GPR models to observe only 50 regression points, and limit both the CNN and GPR models training set sizes to range from only 50 to 5000 dispersion relations. For each training set size, we train the CNN for a maximum of 30 epochs with early stopping based on a validation set. Training the CNN on the training set of 5000 dispersion relations takes approximately 24 minutes/epoch on an NVIDIA GeForce RTX 3080 Ti GPU. For each training set size, we also compute a new covariance function for the GPR, taking only 1 s for the largest training set size (5000). Because training a neural network depends on the randomly initialized weights of the network, we repeat the training 10 times with different random initializations to get a sense for the variation in results. After measuring the &#119863; 2 and &#119880; 1 norms of the error, we average over all 10 eigenvalue bands, and 3 This exactly transforms the errors to what their values would be if the modulus range were 1000smaller, since the dispersion relation of a unit cell whose modulus is increased by 1000will experience an upshift in frequency at a factor of &#10217; 1000, and because both the linear interpolation and GPR models' predictions (and therefore errors) are linearly proportional to the frequency values of the regression points.</p><p>take the 95% quantile error over unit cells. Additionally, for the CNN, we measure the standard deviation of this error over the ten trials and plot the &#177; one standard deviation spread. The results (Fig. <ref type="figure">11</ref>) show that the GPR model achieves errors significantly lower than the CNN for all training set sizes. This is because we are using relatively small training sets, and neural networks typically require more data to train effectively. For reference, Finol et al. used a minimum of 20,000 and up to 100,000 dispersion relations to train their CNN. In general, it is a nontrivial task to adjust the architecture (and therefore expressivity) of a neural network to be appropriate for the amount of training data that you have. This process generally involves a substantial amount of trial-and-error and hyperparameter tuning, which can be costly in terms of time and effort. Note that in this section, we do not adjust the out-of-distribution errors by the factor of &#10217; 1000 because this transformation would not be valid for the CNN, so in-distribution and out-of-distribution results cannot be directly compared against each other. For both in-distribution and out-of-distribution, we see the CNN gradually improve with training set size in the &#119863; 2 norm, but not in the &#119880; 1 norm. This makes sense, because the loss function that the CNN uses (mean squared error) is not sensitive to mismatches in gradients (&#119880; 1 error). </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="7.">Discussion</head><p>Interest in the design of multi-functional wave devices and the high computational cost of dispersion relation computations motivate the need for more efficient methods of dispersion relation evaluation, including surrogate models. We have introduced a new GPR-based surrogate model for the accelerated computation of dispersion relations over the full irreducible Brillouin zone.</p><p>The GPR model builds its covariance function from data and is able to learn from datasets that are 2-3 orders of magnitude smaller than datasets required by the demonstrated deep learning approaches to date. Instead of involving a typical deep learning training process, the model uses only a simple covariance calculation to capture the data trends. The low requirement for data, along with the avoidance of a typical training process, massively reduces the overhead cost to set up the model, allowing the model to be more easily repurposed for new design tasks.</p><p>Because the model never directly observes the parameters governing the unit cell design, it can seamlessly train on unit cells represented in one format (e.g. pixelated/voxelated) and subsequently generalize its predictions to unit cells of other representations (e.g. parametric). This inherent quality makes the model versatile, emphasizing its potential to be effectively applied across a wide spectrum of design scenarios.</p><p>Finally, the model can supply analytically computed gradients for use with gradient-based design optimization, along with uncertainty estimates -both highly useful tools for design tasks. For optimization problems where deviation from the solution of the variational method cannot be tolerated, the surrogate model can simply be used for the first several iterations of optimization and then handed-off to a slower, but more exact dispersion evaluation method. Further, the model can work in tandem with existing, highly specialized variational methods for dispersion computations. We hope that by increasing the computational accessibility of where &#969; denotes conjugate transpose.</p><p>By taking a gradient with respect to a generic variable 4, we obtain Eq. (C.3). For now, consider 4 to be a scalar. To generalize to vector 4 (possibly as a design vector or a wavevector), simply repeat these computations for each entry of 4. The product rule is used here.</p><p>There are two things that can be done with this equation. First, if we only want the gradient of the eigenvalue with respect to a design vector, we can left-multiply Eq. (C.3) by &#120602; &#969; . Then, applying Eq. (C.2), we can see that</p><p>Alternatively, if the gradient of the eigenvector &#120602; is also desired, Eq. (C.3) can be rearranged to</p><p>If 4 &#982; R and 2, 3 &#982; R &#8504; , then this system has &#8504; equations but 2&#8504; unknowns (or in general if 4 &#982; R &#119862; , and 2, 3 &#982; R &#8504; , then this system has &#8504;&#119862; equations but &#8504;(&#119862; + 1) unknowns). This is because eigenvectors are only determined up to their scale. To provide the extra &#8504; equations required to solve, we can use an eigenvector normalization equation. It is standard to normalize eigenvectors by their mass matrix.</p><p>By differentiating, we arrive at</p><p>If our eigenvector &#120602; were purely real, we could say:</p><p>This would make Eq. (C.7) easy to rewrite so that the unknowns on the LHS only receive operations from the left. Then we could solve</p><p>However, in this case, our Bloch-Floquet periodic boundary conditions cause our eigenvector &#120602; to be complex, so in general</p><p>&#120593;4 ) &#969; 3&#120602;) &#969; = &#120602; &#969; 3 &#120593;&#120602; &#120593;4 (C.9) and therefore ( &#120593;&#120602; &#120593;4 ) &#969; 3&#120602; = (&#120602; &#969; 3 &#120593;&#120602; &#120593;4 ) &#969; (C.10) By substituting Eq. (C.10) into Eq. (C.7), we can arrive at (&#120602; &#969; 3 &#120593;&#120602; &#120593;4 ) &#969; + &#120602; &#969; 3 &#120593;&#120602; &#120593;4 = &#949;&#120602; &#969; &#120593;3 &#120593;4 &#120602; (C.11) In other words, 2 Re &#10216; &#120602; &#969; 3 &#120593;&#120602; &#120593;4 &#10217; = &#949;&#120602; &#969; &#120593;3 &#120593;4 &#120602; (C.12) And there is no constraint on the imaginary component. In other words, Im &#10216; &#120602; &#969; 3 &#120593;&#120602; &#120593;4 &#10217; = anything (C.13)</p><p>To solve this, we can break up the imaginary and real equations, and write them individually. This turns 3 complex equations into 5 real equations. The reason we do not obtain 6 real equations from the 3 complex equations (as one may expect) is that Eq. (C.11) actually only provides one real equation (note that of Eqs. (C.12), (C.13), only Eq. (C.12) tells us something useful). Luckily, because our eigenvectors are complex, they not only need a constraint in magnitude, but also in complex angle. Note that if &#120602; is an eigenvector, then &#120602;.&#8883; &#120589;&#119882; is also an eigenvector for any ., &#119882; &#982; R. In other words, the eigenvector can be multiplied by any complex scalar, and still be an eigenvector. For this reason, we not only need to constrain the magnitude of &#120602; (as we have done with Eq. (C.6)), we also need to constrain the complex angle of the entries of &#120602;. To do this, we can simply enforce that the first entry of &#120602; is purely real. This can be written as )</p><p>)</p><p>)</p><p>Now, let us say we want to optimize the group velocity of a wave. The group velocity is the gradient of the frequency, &#120603;, with respect to the wavevector, &#8882;. As with 4, it is helpful to think of &#8882; as a scalar initially, then generalize to vector &#8882; by repeating the computation for each component of the wavevector. First, we know from Eq. (C.4) that the gradient of the eigenvalue, &#120603; 2 , with respect to the wavevector, &#8882;, for a given branch and wavevector can be determined by</p><p>Note that Eq. (C.17) gives &#120593;&#120603; 2 &#120593;&#8882; , and does not directly give the group velocity, which is &#120593;&#120603; &#120593;&#8882; . To obtain the group velocity, we can use the chain rule. Consider two functions 7 (&#8882;) and &#119875;(&#8882;), such that 7 (&#8882;) = &#119875;(&#8882;) 2 . &#120593;&#120603; &#120593;&#8882; = 1 2&#120603; &#120593;6 &#120593;&#8882; (C.19) Using Eqs. (C.17), (C.19), we can write an analytical equation to compute the group velocity. &#120593;&#120603; &#120593;&#8882; = 1 2&#120603; &#120602; &#969; ( &#120593;2 &#120593;&#8882; &#949; 6 &#120593;3 &#120593;&#8882; )&#120602; (C.20) Note that this same equation can be used to compute the design sensitivity of the eigenfrequency, &#120603;, (in contrast to Eq. (C.4), which computes the gradient of the eigenvalue, 6). &#120593;&#120603; &#120593;4 = 1 2&#120603; &#120602; &#969; ( &#120593;2 &#120593;4 &#949; 6 &#120593;3 &#120593;4 )&#120602; (C.21)</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>&#119875;(&#8882;) =</head><p>By taking the gradient of Eq. (C.17) with respect to a design vector, we can aim to obtain the design sensitivity that would be used for a gradient-based optimization of group velocity.</p><p>First, to simplify notation, define the matrix 5 as follows.</p><p>5 = &#120593;2 &#120593;&#8882; &#949; 6 &#120593;3 &#120593;&#8882; (C.22) Substituting into Eq. (C.20) shows &#120593;&#120603; &#120593;&#8882; = 1 2&#120603; &#120602; &#969; 5&#120602; (C.23) Next, take the gradient with respect to a design vector, 4. &#120593; &#120593;4 &#8971; &#120593;&#120603; &#120593;&#8882; { = &#120593; 2 &#120603; &#120593;4&#120593;&#8882; = &#120593; &#120593;4 &#10216; 1 2&#120603; &#10217; &#120602; &#969; 5&#120602; + 1 2&#120603; &#120593;&#120602; &#120593;4 &#969; 5&#120602; + 1 2&#120603; &#120602; &#969; &#120593;5 &#120593;4 &#120602; + 1 2&#120603; &#120602; &#969; 5 &#120593;&#120602; &#120593;4 (C.24)</p><p>Next, let us note how to find some of the quantities needed to use Eq. (C.24).</p><p>&#8226; &#120593;&#120602; &#120593;4 can be found by solving the linear system given by Eq. (C.16).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>&#120593;4&#120593;&#8882;</head><p>As for computing the derivatives of the system matrices 2, 3, we can recall that they are constructed by applying wavevectordependent transformation matrices to design-dependent full system matrices 2 7 , 3 7 . 2 = &#119864; &#969; 2 7 &#119864; 3 = &#119864; &#969; 3 7 &#119864; (C.26) &#120593;2 &#120593;&#8882; = &#120593;&#119864; &#120593;&#8882; &#969; 2 7 &#119864; + &#119864; &#969; 2 7 &#120593;&#119864; &#120593;&#8882; &#120593;3 &#120593;&#8882; = &#120593;&#119864; &#120593;&#8882; &#969; 3 7 &#119864; + &#119864; &#969; 3 7 &#120593;&#119864; &#120593;&#8882; (C.27) &#120593;2 &#120593;4 = &#119864; &#969; &#120593;2 7 &#120593;4 &#119864; &#120593;3 &#120593;4 = &#119864; &#969; &#120593;3 7 &#120593;4 &#119864; (C.28) &#120593; 2 2 &#120593;4&#120593;&#8882; = &#120593;&#119864; &#120593;&#8882; &#969; &#120593;2 7 &#120593;4 &#119864; + &#119864; &#969; &#120593;2 7 &#120593;4 &#120593;&#119864; &#120593;&#8882; &#120593; 2 3 &#120593;4&#120593;&#8882; = &#120593;&#119864; &#120593;&#8882; &#969; &#120593;3 7 &#120593;4 &#119864; + &#119864; &#969; &#120593;3 7 &#120593;4 &#120593;&#119864; &#120593;&#8882; (C.29)</p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1" xml:id="foot_0"><p>The dataset was constructed with the following parameters: &#8463; 7 = 1, &#8925; = 0.5, &#8503; = 1 m, &gt; &#119865;&#120589;&#120599; = 16, &gt; 8&#8503;&#119870; =</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_1"><p>2, &#119878; 8&#120589;&#8504; = 200 MPa, &#119878; 8&#8503;&#120599; = 200 GPa, &#120576; 8&#120589;&#8504; = 800 kg+m<ref type="bibr">3</ref> , &#120576; 8&#8503;&#120599; = 8000 kg+m<ref type="bibr">3</ref> , &#119879; 8&#120589;&#8504; = 0, &#119879; 8&#8503;&#120599; = 0.5. The wavevector resolution of each dispersion relation in the dataset is 101 -51.</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="2" xml:id="foot_2"><p>For the traditional linear interpolation model, one simply evaluates the dispersion relation on a grid of evenly spaced points and linearly interpolates if evaluation is needed at points that do not belong to the grid.</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="4" xml:id="foot_3"><p>For example, if a dataset of dispersion relations has a resolution in reciprocal space of 201 -201, the covariance matrix is of size 40 401 -40 401, occupying 13.06 GB of memory when stored in double precision. This means that if the covariance between even two bands at this resolution is considered, the resulting covariance matrix will be 80 802 -80 802, occupying</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_4"><p>52.24 GB of memory.</p></note>
		</body>
		</text>
</TEI>
