Optimizing bulk data transfers using network measurements: A practical case

Abstract

The quality of the connectivity provided by the network infrastructure of a Grid is a crucial factor to guarantee the accessibility of Grid services, schedulate efficiently processing and data transfer activity on the Grid and meet QoS expectations. Yet most Grid application do not take into consideration the expected performance of the network resources they plan to use. In this paper we describe the effective use of a Grid Monitoring framework, whose measurements are used to introduce netwrok aware features in a legacy application. We use GlueDomains, a network monitoring framework oriented to Grid infrastructures that measures a small (although possibly extensible) set of network parameters. Such framework works off the shelf with minimal administrative effort, is reliable, and has a negligible impact on system operation. The deployment covers a Metropolitan Grid infrastructure, aimed at supporting a data intensive eScience application. We describe a real use case consisting of bulk data trasfers during the operation of the Grid for the Virgo experiment.