An official website of the United States government
Outages from natural disasters, political events, software or hardware issues, and human error place a huge cost on e-commerce (\$66k per minute at Amazon). While several existing systems detect Internet outages, these systems are often too inflexible, with fixed parameters across the whole internet with CUSUM-like change detection. We instead propose a system using passive data, to cover both IPv4 and IPv6, customizing parameters for each block to optimize the performance of our Bayesian inference model. Our poster describes our three contributions: First, we show how customizing parameters allows us often to detect outages that are at both fine timescales (5 minutes) and fine spatial resolutions (/24 IPv4 and /48 IPv6 blocks). Our second contribution is to show that, by tuning parameters differently for different blocks, we can scale back temporal precision to cover more challenging blocks. Finally, we show our approach extends to IPv6 and provides the first reports of IPv6 outages.
more »
« less
Internet Censorship and Economic Impacts: A Case Study of Internet Outages in India
The objective of this research paper is to provide a methodology for measuring the financial impacts of Internet outages. The financial impacts are measured against a Nation’s Gross Domestic Product (GDP) for several states in India to project the aftermath of Internet outage episodes. In addition historical trends are analyzed to help derive predictive logic for Internet outages in order to forecast Internet shutdown incidents based on antecedent events. Results demonstrate the proposed method for determining economic loss highlights several factors and may at times be influenced by the frequency of events compared to overall size of GDP. In addition, historical trend analysis of Internet outages suggests that a predictive model to forecast future outages can help reveal underlying policies toward Internet censorship.
more »
« less
- Award ID(s):
- 1704113
- PAR ID:
- 10463455
- Date Published:
- Journal Name:
- 24th AMCIS 2018 Proceedings
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Understanding the nature and characteristics of Internet events such as route changes and outages can serve as the starting point for improvements in network configurations, management and monitoring practices. However, the scale, diversity, and dynamics of network infrastructure makes event detection and analysis challenging. In this paper, we describe a new approach to Internet event measurement, identification and analysis that provides a broad and detailed perspective without the need for new or dedicated infrastructure or additional network traffic. Our approach is based on analyzing data that is readily available from Network Time Protocol (NTP) servers. NTP is one of the few on-by-default services on clients, thus NTP servers have a broad perspective on Internet behavior. We develop a tool for analyzing NTP traces called Tezzeract, which applies Robust Principal Components Analysis to detect Internet events. We demonstrate Tezzeract’s efficacy by conducting controlled experiments and by applying it to data collected over a period of 3 months from 19 NTP servers. We also compare and contrast Tezzeract’s perspective with reported outages and events identified through active probing. We find that while there is commonality across methods, NTP-based monitoring provides a unique perspective that complements prior methods.more » « less
-
—Understanding the nature and characteristics of Internet events such as route changes and outages can serve as the starting point for improvements in network configurations, management and monitoring practices. However, the scale, diversity, and dynamics of network infrastructure makes event detection and analysis challenging. In this paper, we describe a new approach to Internet event measurement, identification and analysis that provides a broad and detailed perspective without the need for new or dedicated infrastructure or additional network traffic. Our approach is based on analyzing data that is readily available from Network Time Protocol (NTP) servers. NTP is one of the few on-by-default services on clients, thus NTP servers have a broad perspective on Internet behavior. We develop a tool for analyzing NTP traces called Tezzeract, which applies Robust Principal Components Analysis to detect Internet events. We demonstrate Tezzeract’s efficacy by conducting controlled experiments and by applying it to data collected over a period of 3 months from 19 NTP servers. We also compare and contrast Tezzeract’s perspective with reported outages and events identified through active probing. We find that while there is commonality across methods, NTP-based monitoring provides a unique perspective that complements prior methods.more » « less
-
This paper empirically evaluates the potentially non-linear nexus between financial indicators and the distribution of future GDP growth, using a rich set of macroeconomic and financial variables covering 13 advanced economies. We evaluate the out-of-sample forecast performance of financial variables for GDP growth, including a fully real-time exercise based on a flexible non-parametric model. We also use a parametric model to estimate the moments of the time-varying distribution of GDP and evaluate their in-sample estimation uncertainty. Our overall conclusion is pessimistic: Moments other than the conditional mean are poorly estimated, and no predictors we consider provide robust and precise advance warnings of tail risks or indeed about any features of the GDP growth distribution other than the mean. In particular, financial variables contribute little to such distributional forecasts, beyond the information contained in real indicators.more » « less
-
Installation of line surge arresters on transmission towers can significantly improve the line lightning performance. However, it is not always economically beneficial to install the line surge arresters on every tower in the network. This paper proposes the method for optimal placement of line surge arresters that minimizes the overall risk of lightning related outages and disturbances, while staying within the required budgetary limits. A variety of data sources was used: utility asset management, geographical information system, lightning detection network, historical weather and weather forecasts, vegetation and soil properties. The proposed solution is focused on predicting the risk of transmission line insulators experiencing an insulation breakdown due to the accumulated deterioration over time and an instant impact of a given lightning strike. The linear regression prediction-based algorithm observes the impact of various historical events on each individual component. In addition, the spatial distribution of various impacts is used to enhance the predictive performance of the algorithm. The developed method is fully automated, making it a unique large scale automated decision-making risk model for real-time management of the transmission line lightning protection performance. Based on the observation of risk tracking and prediction, the zones with highest probability of lightning caused outages are identified. Then the optimization algorithm is applied to determine the best placement strategy for the limited number of line surge arresters that would provide the highest reduction in the overall risk for the network. Economic factors are taken into account in order to develop installation schedule that would enable economically efficient management of line lightning protection performance for utilitiesmore » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
