Challenges in inferring internet congestion using throughput measurements

Sundaresan, Srikanth; Deng, Xiaohong; Feng, Yongjin; Lee, Danny; Dhamdhere, Amogh

doi:10.1145/3131365.3131382

Cited by 32 publications

(17 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We performed additional experiments demonstrating that bdrmapIT's performance does not diminish as we reduce the number of VPs. Our results suggest that bdrmapIT can form the foundation upon which to address other network diagnostic challenges, including congestion measurement [32,38], resilience assessment [14,25,33,36], and traffic estimation [35]. We publicly release our source code.…”

Section: Resultsmentioning

confidence: 99%

“…Other congestion inference [37] and resilience assessment [14,25,33,36] research could be extended to identify networks and links experiencing congestion. A new border mapping tool could address well-known pitfalls with less rigorous approaches to identifying interdomain links [32,38]. MAP-IT was already instrumental in uncovering bugs in traceroute implementations [34]-investigation of anomalous MAP-IT inferences revealed that the M-lab traceroutes used as input were corrupted.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Pushing the Boundaries with bdrmapIT

Marder

Luckie

Dhamdhere

et al. 2018

Proceedings of the Internet Measurement Conference 2018

Self Cite

View full text Add to dashboard Cite

Two complementary approaches to mapping network boundaries from traceroute paths recently emerged [27,31]. Both approaches apply heuristics to inform inferences extracted from traceroute measurement campaigns. bdrmap [27] used targeted traceroutes from a specific network, alias resolution probing techniques, and AS relationship inferences, to infer the boundaries of that specific network and the other networks attached at each boundary. MAPIT [31] tackled the ambitious challenge of inferring all AS-level network boundaries in a massive archived collection of traceroutes launched from many different networks. Both were substantial contributions to the state-of-the-art, and inspired a collaboration to explore the potential to combine the approaches. We present and evaluate bdrmapIT, the result of that exploration, which yielded a more complete, accurate, and general solution to this persistent and central challenge of Internet topology research. bdrmapIT achieves 91.8%-98.8% accuracy when mapping AS boundaries in two Internet-wide traceroute datasets, vastly improving on MAP-IT's coverage without sacrificing bdrmap's ability to map a single network. The bdrmapIT source code is available at https://git.io/fAsI0.

show abstract

Section: Resultsmentioning

confidence: 99%

mentioning

confidence: 99%

Pushing the Boundaries with bdrmapIT

Marder

Luckie

Dhamdhere

et al. 2018

Proceedings of the Internet Measurement Conference 2018

Self Cite

View full text Add to dashboard Cite

show abstract

“…The Measurement Lab studies [9,51] did not have path information, without which it is challenging to conclude that observed congestion is at the interconnection (it could be internal to ASes). Futhermore, the crowd-sourced nature of NDT tests used in these studies make it difficult to conclude that observed diurnal variations are due to congestion as opposed to variations due to a different testing sample [65]. In 2017, Sundaresan et al [64] proposed a technique that uses TCP connection statistics to determine if a TCP flow experienced self-induced or external congestion.…”

Section: Related Workmentioning

confidence: 99%

“…We note some caveats with correlating NDT and TSLP measurements. First, factors beyond interdomain link congestion could affect end-to-end throughput, e.g., home network congestion, server load, and congestion elsewhere on the end-to-end path [65]. For this reason, we do not use NDT throughput to infer interdomain link congestion.…”

Section: Correlation With Ndt Throughputmentioning

confidence: 99%

“…Some content providers release end-to-end performance data (e.g., video quality reports) that provide aggregate information about performance between themselves and access providers [42,54]. However, end-to-end statistics cannot accurately map congestion to specific interconnection points, and the coverage of crowd-sourced measurements is low [65]. In 2016, seven access providers volunteered anonymized and aggregated statistics of interdomain link utilization, but the level of aggregation prevented inference of congestion on individual links [35].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Inferring persistent interdomain congestion

Dhamdhere

Clark

Gamero-Garrido

et al. 2018

Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication

Self Cite

View full text Add to dashboard Cite

There is significant interest in the technical and policy communities regarding the extent, scope, and consumer harm of persistent interdomain congestion. We provide empirical grounding for discussions of interdomain congestion by developing a system and method to measure congestion on thousands of interdomain links without direct access to them. We implement a system based on the Time Series Latency Probes (TSLP) technique that identifies links with evidence of recurring congestion suggestive of an under-provisioned link. We deploy our system at 86 vantage points worldwide and show that congestion inferred using our lightweight TSLP method correlates with other metrics of interconnection performance impairment. We use our method to study interdomain links of eight large U.S. broadband access providers from March 2016 to December 2017, and validate our inferences against ground-truth traffic statistics from two of the providers. For the period of time over which we gathered measurements, we did not find evidence of widespread endemic congestion on interdomain links between access ISPs and directly connected transit and content providers, although some such links exhibited recurring congestion patterns. We describe limitations, open challenges, and a path toward the use of this method for large-scale third-party monitoring of the Internet interconnection ecosystem.

show abstract

Design and Implementation of Web-Based Speed Test Analysis Tool Kit

Yang

Mok

et al. 2022

Passive and Active Measurement

View full text Add to dashboard Cite

Challenges in inferring internet congestion using throughput measurements

Cited by 32 publications

References 10 publications

Pushing the Boundaries with bdrmapIT

Pushing the Boundaries with bdrmapIT

Inferring persistent interdomain congestion

Design and Implementation of Web-Based Speed Test Analysis Tool Kit

Contact Info

Product

Resources

About