More Like this

1. Improving Service Performance through Multilayer Routing and Service Intelligence in a Network Service Mesh

   https://doi.org/10.1109/ANTS52808.2021.9936995  

   Hu, Boyang ; Nadig, Deepak ; Ramamurthy, Byrav ( December 2021 , 2021 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS))

   Network service mesh architectures, by interconnecting cloud clusters, provide access to services across distributed infrastructures. Typically, services are replicated across clusters to ensure resilience. However, end-to-end service performance varies mainly depending on the service loads experienced by individual clusters. Therefore, a key challenge is to optimize end-to-end service performance by routing service requests to clusters with the least service processing/response times. We present a two-phase approach that combines an optimized multi-layer optical routing system with service mesh performance costs to improve end-to-end service performance. Our experimental strategy shows that leveraging a multi-layer architecture in combination with service performance information improves end-to-end performance. We evaluate our approach by testing our strategy on a service mesh layer overlay on a modified continental united states (CONUS) network topology. 

   more » « less
2. Function-as-a-Service Application Service Composition: Implications for a Natural Language Processing Application

   https://doi.org/https://doi.org/10.1145/3366623.3368141  

   Mohammadbagher, Fotouhi ; Chen, Derek ; Lloyd, Wes ( December 2019 , WOSC '19: Proceedings of the 5th International Workshop on Serverless Computing)
3. FPGAs-as-a-Service Toolkit (FaaST)

   https://doi.org/10.1109/H2RC51942.2020.00010  

   Rankin, Dylan ; Krupa, Jeffrey ; Harris, Philip ; Flechas, Maria Acosta ; Holzman, Burt ; Klijnsma, Thomas ; Pedro, Kevin ; Tran, Nhan ; Hauck, Scott ; Hsu, Shih-Chieh ; et al ( November 2020 , 2020 IEEE/ACM International Workshop on Heterogeneous High-performance Reconfigurable Computing (H2RC))

   null (Ed.)

   Computing needs for high energy physics are already intensive and are expected to increase drastically in the coming years. In this context, heterogeneous computing, specifically as-a-service computing, has the potential for significant gains over traditional computing models. Although previous studies and packages in the field of heterogeneous computing have focused on GPUs as accelerators, FPGAs are an extremely promising option as well. A series of workflows are developed to establish the performance capabilities of FPGAs as a service. Multiple different devices and a range of algorithms for use in high energy physics are studied. For a small, dense network, the throughput can be improved by an order of magnitude with respect to GPUs as a service. For large convolutional networks, the throughput is found to be comparable to GPUs as a service. This work represents the first open-source FPGAs-as-a-service toolkit. 

   more » « less
4. Cloudburst: stateful functions-as-a-service

   https://doi.org/10.14778/3407790.3407836  

   Sreekanti, Vikram ; Wu, Chenggang ; Lin, Xiayue Charles ; Schleier-Smith, Johann ; Gonzalez, Joseph E. ; Hellerstein, Joseph M. ; Tumanov, Alexey ( August 2020 , Proceedings of the VLDB Endowment)

   null (Ed.)
5. FPGAs-as-a-Service Toolkit (FaaST)

   Rankin, Dylan ; Krupa, Jeffrey ; Harris, Philip ; Flechas, Maria ; Holzman, Burt ; Klijnsma, Thomas ; Pedro, Kevin ; Tran, Nhan ; Hauck, Scott ; Hsu, Shih-Chieh ; et al ( October 2020 , ArXivorg)

   null (Ed.)

   Computing needs for high energy physics are already intensive and are expected to increase drastically in the coming years. In this context, heterogeneous computing, specifically as-a-service computing, has the potential for significant gains over traditional computing models. Although previous studies and packages in the field of heterogeneous computing have focused on GPUs as accelerators, FPGAs are an extremely promising option as well. A series of workflows are developed to establish the performance capabilities of FPGAs as a service. Multiple different devices and a range of algorithms for use in high energy physics are studied. For a small, dense network, the throughput can be improved by an order of magnitude with respect to GPUs as a service. For large convolutional networks, the throughput is found to be comparable to GPUs as a service. This work represents the first open-source FPGAs-as-a-service toolkit. 

   more » « less