skip to main content


Title: Machine-learning-aided cognitive reconfiguration for flexible-bandwidth HPC and data center networks [Invited]

This paper proposes a machine-learning (ML)-aided cognitive approach for effective bandwidth reconfiguration in optically interconnected datacenter/high-performance computing (HPC) systems. The proposed approach relies on a Hyper-X-like architecture augmented with flexible-bandwidth photonic interconnections at large scales using a hierarchical intra/inter-POD photonic switching layout. We first formulate the problem of the connectivity graph and routing scheme optimization as a mixed-integer linear programming model. A two-phase heuristic algorithm and a joint optimization approach are devised to solve the problem with low time complexity. Then, we propose an ML-based end-to-end performance estimator design to assist the network control plane with intelligent decision making for bandwidth reconfiguration. Numerical simulations using traffic distribution profiles extracted from HPC applications traces as well as random traffic matrices verify the accuracy performance of the ML design estimator (<<#comment/>9%<#comment/>error) and demonstrate up to5×<#comment/>throughput gain from the proposed approach compared with the baseline Hyper-X network using fixed all-to-all intra/inter-portable data center interconnects.

 
more » « less
NSF-PAR ID:
10210534
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Journal of Optical Communications and Networking
Volume:
13
Issue:
6
ISSN:
1943-0620; JOCNBB
Page Range / eLocation ID:
Article No. C10
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper presents a cognitive flexible-bandwidth optical interconnect architecture for datacom networks. The proposed architecture leverages silicon photonic reconfigurable all-to-all switch fabrics interconnecting top-of-rack switches arranged in a Hyper-X-like topology with a cognitive control plane for optical reconfiguration by self-supervised learning. The proposed approach makes use of a clustering algorithm to learn the traffic patterns from historical traces. We developed a heuristic algorithm for optimizing the intra-pod connectivity graph for each identified traffic pattern. Further, to mitigate the scalability issue induced by frequent clustering operations, we parameterized the learned traffic patterns by a support vector machine classifier. The classifier is trained offline by self-labeled data to enable the classification of traffic matrices during online operations, thereby facilitating cognitive reconfiguration decision making. The simulation results show that compared with a static all-to-all interconnection, the proposed approach can improve the throughput by up to1.62×<#comment/>while reducing the end-to-end packet latency and flow completion time by up to3.84×<#comment/>and20×<#comment/>, respectively.

     
    more » « less
  2. The ambition of this review is to provide an up-to-date synopsis of the state of 3D printing technology for optical and photonic components, to gauge technological advances, and to discuss future opportunities. While a range of approaches have been developed and some have been commercialized, no single approach can yet simultaneously achieve small detail and low roughness at large print volumes and speed using multiple materials. Instead, each approach occupies a niche where the components/structures that can be created fit within a relatively narrow range of geometries with limited material choices. For instance, the common Fused Deposition Modeling (FDM) approach is capable of large print volumes at relatively high speeds but lacks the resolution needed for small detail (><#comment/>100µ<#comment/>m) with low roughness (><#comment/>9µ<#comment/>m). At the other end of the spectrum, two-photon polymerization can achieve roughness (<<#comment/>15nm) and detail (<<#comment/>140nm) comparable to commercial molded and polished optics. However, the practical achievable print volume and speed are orders of magnitude smaller and slower than the FDM approach. Herein, we discuss the current state-of-the-art 3D printing approaches, noting the capability of each approach and prognosticate on future innovations that could close the gaps in performance.

     
    more » « less
  3. We experimentally demonstrate the utilization of adaptive optics (AO) to mitigate intra-group power coupling among linearly polarized (LP) modes in a graded-index few-mode fiber (GI FMF). Generally, in this fiber, the coupling between degenerate modes inside a modal group tends to be stronger than between modes belonging to different groups. In our approach, the coupling inside theLP11group can be represented by a combination of orbital-angular-momentum (OAM) modes, such that reducing power coupling in OAM set tends to indicate the capability to reduce the coupling inside theLP11group. We employ two output OAM modesl=+1andl=−<#comment/>1as resultant linear combinations of degenerateLP11aandLP11bmodes inside theLP11group of a∼<#comment/>0.6-kmGI FMF. The power coupling is mitigated by shaping the amplitude and phase of the distorted OAM modes. Each OAM mode carries an independent 20-, 40-, or 100-Gbit/s quadrature-phase-shift-keying data stream. We measure the transmission matrix (TM) in the OAM basis withinLP11group, which is a subset of the full LP TM of the FMF-based system. An inverse TM is subsequently implemented before the receiver by a spatial light modulator to mitigate the intra-modal-group power coupling. With AO mitigation, the experimental results forl=+1andl=−<#comment/>1modes show, respectively, that (i) intra-modal-group crosstalk is reduced by><#comment/>5.8dBand><#comment/>5.6dBand (ii) near-error-free bit-error-rate performance is achieved with a penalty of∼<#comment/>0.6dBand∼<#comment/>3.8dB, respectively.

     
    more » « less
  4. We present a performance analysis of compact monolithic optomechanical inertial sensors that describes their key fundamental limits and overall acceleration noise floor. Performance simulations for low-frequency gravity-sensitive inertial sensors show attainable acceleration noise floors on the order of1×<#comment/>10−<#comment/>11m/s2Hz. Furthermore, from our performance models, we devised an optimization approach for our sensor designs, sensitivity, and bandwidth trade space. We conducted characterization measurements of these compact mechanical resonators, demonstratingmQ-products at levels of 250 kg, which highlight their exquisite acceleration sensitivity.

     
    more » « less
  5. Integrated astrophotonic spectrometers are integrated variants of conventional free-space spectrometers that offer significantly reduced size, weight, and cost and immunity to alignment errors, and can be readily integrated with other astrophotonic instruments such as nulling interferometers. Current integrated dispersive astrophotonic spectrometers are one-dimensional devices such as arrayed waveguide gratings or planar echelle gratings. These devices have been limited to104resolving powers and<<#comment/>1000spectral bins due to having limited total optical delay paths and 1D detector array pixel densities. In this paper, we propose and demonstrate a high-resolution and compact astrophotonic serpentine integrated grating (SIG) spectrometer design based on a 2D dispersive serpentine optical phased array. The SIG device combines a 5.2 cm long folded delay line with grating couplers to create a large optical delay path along two dimensions in a compact integrated device footprint. Analogous to free-space crossed-dispersion high-resolution spectrometers, the SIG spectrometer maps spectral content to a 2D wavelength-beam-steered folded-raster emission pattern focused onto a 2D detector array. We demonstrate a SIG spectrometer with∼<#comment/>100kresolving power and∼<#comment/>6750spectral bins, which are approximately an order of magnitude higher than previous integrated photonic designs that operate over a wide bandwidth, in a0.4mm2footprint. We measure a Rayleigh resolution of1.93±<#comment/>0.07GHzand an operational bandwidth from 1540 nm to 1650 nm. Finally, we discuss refinements of the SIG spectrometer that improve its resolution, bandwidth, and throughput. These results show that SIG spectrometer technology provides a path towards miniaturized, high-resolution spectrometers for applications in astronomy and beyond.

     
    more » « less