Experimenting with AWS Direct Connect using Chameleon, ExoGENI, and Internet2 Cloud Connect

Ruth, Paul; Cevik, Mert

doi:10.1109/icnp.2019.8888095

Cited by 4 publications

(1 citation statement)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper we describe the experience of running a half-day Cloud burst in support of IceCube production compute, that required a peak egress network traffic of over 10 GigaBytes per second (GBps) to upload results of simulation compute generated using about 100 fp32 FLOPS of Cloud compute power. All egress traffic was routed over dedicated links, which were provisioned using Internet2 Cloud Connect service [7,8].…”

Section: Introductionmentioning

confidence: 99%

Managing Cloud networking costs for data-intensive applications by provisioning dedicated network links

Sfiligoi

Hare

Schultz

et al. 2021

Practice and Experience in Advanced Research Computing

View full text Add to dashboard Cite

Many scientific high-throughput applications can benefit from the elastic nature of Cloud resources, especially when there is a need to reduce time to completion. Cost considerations are usually a major issue in such endeavors, with networking often a major component; for data-intensive applications, egress networking costs can exceed the compute costs. Dedicated network links provide a way to lower the networking costs, but they do add complexity. In this paper we provide a description of a 100 fp32 PFLOPS Cloud burst in support of IceCube production compute, that used Internet2 Cloud Connect service to provision several logically-dedicated network links from the three major Cloud providers, namely Amazon Web Services, Microsoft Azure and Google Cloud Platform, that in aggregate enabled approximately 100 Gbps egress capability to on-prem storage. It provides technical details about the provisioning process, the benefits and limitations of such a setup and an analysis of the costs incurred. CCS CONCEPTS• Networks → Network performance evaluation; Network measurement; • Applied computing → Physical sciences and engineering; Astronomy.

show abstract

Section: Introductionmentioning

confidence: 99%

Managing Cloud networking costs for data-intensive applications by provisioning dedicated network links

Sfiligoi

Hare

Schultz

et al. 2021

Practice and Experience in Advanced Research Computing

View full text Add to dashboard Cite

show abstract

A Heterogeneous Hybrid Cloud Storage Service Using Storage Gateway with Transfer Acceleration

Nasyir

Winarno

Rasyid

2021

2021 International Electronics Symposium (IES)

View full text Add to dashboard Cite

Achieving End-to-End Connectivity in Global Multi-Domain Networks

Municio

Cevik

Ruth

et al. 2021

IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)

View full text Add to dashboard Cite

Current trends on 5G network programmability evidence the need for end-to-end flexibility from the node and edge all the way to the cloud. Such multi-domain scenarios require realistic testbeds where different task-offloading algorithms, scheduling functions, and service orchestration techniques can be deployed and tested. While many of these research components can be often explored locally in small and isolated testbeds, new 5G demands are requesting for inter-operable platforms with a wider and a more global scope. The goal for these global platforms is that they can cope with multitier hierarchical architectures that are capable to face intense computational processes and heavy network traffic loads, while preserving dependability and keeping a low latency on the task executions and data transmission. In this paper we demonstrate a world-wide attempt to integrate different high-performance testing facilities, located in USA, Belgium, and The Netherlands, to enable experimentation on top of such large and complex architectures. In order to do this, we describe and deploy a multi-domain use case that can benefit from a global hierarchical infrastructure. Finally, we detail the performance characteristics of the deployment, discussing the experiences and technical challenges, and presenting the lessons learned we obtained when building and testing such experimental use case.

show abstract

Experimenting with AWS Direct Connect using Chameleon, ExoGENI, and Internet2 Cloud Connect

Cited by 4 publications

References 2 publications

Managing Cloud networking costs for data-intensive applications by provisioning dedicated network links

Managing Cloud networking costs for data-intensive applications by provisioning dedicated network links

A Heterogeneous Hybrid Cloud Storage Service Using Storage Gateway with Transfer Acceleration

Achieving End-to-End Connectivity in Global Multi-Domain Networks

Contact Info

Product

Resources

About