More Like this

1. Creating a content delivery network for general science on the internet backbone using XCaches

   https://doi.org/10.1051/epjconf/202024504041  

   Fajardo, Edgar; Weitzel, Derek; Rynge, Mats; Zvada, Marian; Hicks, John; Selmeci, Mat; Lin, Brian; Paschos, Pascal; Bockelman, Brian; Hanushevsky, Andrew; et al (January 2020, EPJ Web of Conferences)

   Doglioni, C.; Kim, D.; Stewart, G.A.; Silvestris, L.; Jackson, P.; Kamleh, W. (Ed.)

   A general problem faced by opportunistic users computing on the grid is that delivering cycles is simpler than delivering data to those cycles. In this project XRootD caches are placed on the internet backbone to create a content delivery network. Scientific workflows in the domains of high energy physics, gravitational waves, and others profit from this delivery network to increases CPU efficiency while decreasing network bandwidth use. 

   more » « less
2. Facilitating content distribution in Sub-Saharan Africa through Software-Defined Exchange points

   Ibarra, L.; Bezerra, J.; Lopez, L.F.; Morgan, H.; Cox, D. (November 2017, UbuntuNet Connect 2017)

   Sub-Saharan Africa is the fastest growing region of international Internet capacity in the world. Content in Sub-Saharan Africa is increasing: Microsoft is bringing two new data centers to South Africa, and Google and Akamai have been installing caches. The demand for content distribution within Sub-Saharan Africa is growing as the number of data centers and caches increase. Strategic placement of local compute, storage and networking is increasingly important in response to demands in local content distribution growth. Internet eXchange Points (IXPs) are resources that play a central role in interconnecting many networks. In addition, their role has been expanding in importance for bringing content closer to end users. For example, as content traffic continues to rise, IXPs are in the foreground of the peering issues between content providers and access networks. IXPs are considered a natural resource to evolve into a SDX, because they offer a physical location where multiple networks meet to exchange traffic and to peer (exchange routes). This paper presents a Software-Defined Exchange as a novel internetworking paradigm to facilitate content distribution. A SDX facilitates sharing of compute, storage and networking resources among multiple independent administrative domains, such as ISPs, CDNs, or NRENs. A survey of the most relevant SDX studies and use cases for a SDX, including content distribution, will be presented. Finally, deployment considerations and projects implementing SDXs will be discussed. 

   more » « less
3. Compute- and Data-Intensive Networks: The Key to the Metaverse

   https://doi.org/10.1109/6GNet54646.2022.9830429  

   Cai, Yang; Llorca, Jaime; Tulino, Antonia M.; Molisch, Andreas F. (July 2022, 1st International Conference on 6G Networking (6GNet))

   The worlds of computing, communication, and storage have for a long time been treated separately, and even the recent trends of cloud computing, distributed computing, and mobile edge computing have not funda-mentally changed the role of networks, still designed to move data between end users and pre-determined compu-tation nodes, without true optimization of the end-to-end compute-communication process. However, the emergence of Metaverse applications, where users consume multime-dia experiences that result from the real-time combination of distributed live sources and stored digital assets, has changed the requirements for, and possibilities of, systems that provide distributed caching, computation, and com-munication. We argue that the real-time interactive nature and high demands on data storage, streaming rates, and processing power of Metaverse applications will accelerate the merging of the cloud into the network, leading to highly-distributed tightly-integrated compute- and data-intensive networks becoming universal compute platforms for next-generation digital experiences. In this paper, we first describe the requirements of Metaverse applications and associated supporting infrastructure, including rele-vant use cases. We then outline a comprehensive cloud network flow mathematical framework, designed for the end-to-end optimization and control of such systems, and show numerical results illustrating its promising role for the efficient operation of Metaverse-ready networks. 

   more » « less
4. An intelligent Data Delivery Service for and beyond the ATLAS experiment

   https://doi.org/10.1051/epjconf/202125102007  

   Guan, Wen; Maeno, Tadashi; Bockelman, Brian Paul; Wenaus, Torre; Lin, Fahui; Padolski, Siarhei; Zhang, Rui; Alekseev, Aleksandr (January 2021, EPJ Web of Conferences)

   Biscarat, C.; Campana, S.; Hegner, B.; Roiser, S.; Rovelli, C.I.; Stewart, G.A. (Ed.)

   The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, and main processing in various workflows. It is an experiment-agnostic service around a workflow-oriented structure to work with existing and emerging use cases in ATLAS and other experiments. Here we will present the motivation for iDDS, its design schema and architecture, use cases and current status, and plans for the future. 

   more » « less
5. Demo: EdgeVPN.io: Open-source Virtual Private Network for Seamless Edge Computing with Kubernetes

   https://doi.org/10.1109/SEC50012.2020.00032  

   Figueiredo, Renato; Subratie, Kensworth (November 2020, 2020 IEEE/ACM Symposium on Edge Computing (SEC))

   null (Ed.)

   Edge and fog computing encompass a variety of technologies that are poised to enable new applications across the Internet that support data capture, storage, processing, and communication across the networking continuum. These environments pose new challenges to the design and implementation of networks-as membership can be dynamic and devices are heterogeneous, widely distributed geographically, and in proximity to end-users, as is the case with mobile and Internet-of-Things (IoT) devices. We present a demonstration of EdgeVPN.io (Evio for short), an open-source programmable, software-defined network that addresses challenges in the deployment of virtual networks spanning distributed edge and cloud resources, in particular highlighting its use in support of the Kubernetes container orchestration middleware. The demo highlights a deployment of unmodified Kubernetes middleware across a virtual cluster comprising virtual machines deployed both in cloud providers, and in distinct networks at the edge-where all nodes are assigned private IP addresses and subject to different NAT (Network Address Translation) middleboxes, connected through an Evio virtual network. The demo includes an overview of the configuration of Kubernetes and Evio nodes and the deployment of Docker-based container pods, highlighting the seamless connectivity for TCP/IP applications deployed on the pods. 

   more » « less