Performance Studies of the StoRM Storage Resource Manager

Carbone, A.; dell’Agnello, Luca; Forti, A.; Ghiselli, A.; Lanciotti, E.; Magnoni, L.; Mazzucato, M.; Santinelli, R.; Sapunenko, V.; Vagnoni, V.; Zappi, Riccardo

doi:10.1109/e-science.2007.59

Cited by 18 publications

(14 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other implementations can manage generic storage system POSIX compliant [13], such as BeStMan [14], DPM [15] and StoRM [16] [17] solutions. Moreover, Disk Pool Manager (DPM), developed at CERN, exhibits features typical of a storage system.…”

Section: Srm Servicesmentioning

confidence: 99%

See 1 more Smart Citation

StoRM: A flexible solution for Storage Resource Manager in grid

Magnoni

Zappi

Ghiselli

2008

2008 IEEE Nuclear Science Symposium Conference Record

View full text Add to dashboard Cite

In these times, scientific data intensive applications generate ever-increasing volumes of data that need to be stored, managed, and shared between geographically distributed communities. Data centres are normally able to provide tens of petabytes of storage space through a large variety of heterogeneous storage and file systems. However, storage systems shared by applications need a common data access mechanism, which allocates storage space dynamically, manages stored content, and automatically remove unused data to avoid clogging data stores. To accommodate these needs, the concept of Storage Resource Managers (SRMs) was devised in the context of a project that involved High Energy Physics (HEP) and Nuclear Physics (NP). The Storage Resource Manager (SRM) interface specification was defined and evolved into an international collaboration in the context of the Open Grid Forum (OGF). SRM interface provides the technology needed to share geographically distributed heterogeneous storage resources, with an effective and common interface regardless of the type of the back-end system being used. By implementing the SRM interface, grid storage services provide a consistent homogeneous interface to the Grid to manage storage resource as well as advanced functionality such as dynamic space allocation and file management on shared storage systems. Within Worldwide LHC Grid project exists more than five interoperating implementations of SRM services, and every one shows peculiarity. In this paper, we describe the flexibility of StoRM service, an implementation of the Storage Resource Manager Interface version 2.2. StoRM is designed to foster the adoption of cluster file systems, and thanks to the marked flexibility, StoRM can be used in small data centre with human resource deficiency to administer an other grid service and, at the same time, capable to grow in terms of storage managed and workload. StoRM can be used to manage any storage resources with any kind of POSIX filesystem in a transparent way. As demonstration of the StoRM flexibility, the paper describes how applications scheduled via Grid can access files on a file-system directly via POSIX calls, how StoRM can be deployed in a clustered configuration to address scalability needs and finally how StoRM can be used to manage also storage classes based on Storage Cloud, like Amazon Simple Storage Service (S3).

show abstract

Section: Srm Servicesmentioning

confidence: 99%

“…The StoRM service [17] is a storage resource manager for generic disk based storage systems that overcome this limitation separating the data management layer from the underlying storage systems characteristics.…”

Section: Stormmentioning

confidence: 99%

StoRM: A flexible solution for Storage Resource Manager in grid

Magnoni

Zappi

Ghiselli

2008

2008 IEEE Nuclear Science Symposium Conference Record

View full text Add to dashboard Cite

show abstract

“…Since GPFS does not offer natively a Storage Resource Manager (SRM) interface, which is necessary to access and manage the data volumes in a Grid environment, a specific project called StoRM [7] has been developed for providing it with the necessary SRM capabilities [8]. StoRM is in production at CNAF for ATLAS experiment T0D1 Storage Class since the end of 2007, while to support T1D1 for LHCb some extensions were needed.…”

Section: Introductionmentioning

confidence: 99%

StoRM-GPFS-TSM: A new approach to hierarchical storage management for the LHC experiments

Cavalli

dell’Agnello

Ghiselli

et al. 2010

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

“…Furthermore, having to enable the access to the WLCG users, the interaction between the storage system and the Grid layers was handled by StoRM [4], an implementation of the standard Storage Resource Management (SRM) (http://sdm.lbl.gov/srm-wg) interface developed at INFN. The adoption of the StoRM layer over a suitable GPFS testbed effectively provided a clear evidence about scalability and reliability of the StoRM and GPFS coupling [5].…”

mentioning

confidence: 99%

INFN-CNAF Tier-1 Storage and Data Management Systems for the LHC Experiments

Andreotti¹,

Cavalli²,

Ciocca³

et al. 2011

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Abstract.INFN-CNAF, the italian Tier-1, houses more than 10 PB of tape space and 6 PB of disk space used by the global physics user communities including the LHC experiments. In this context, an innovative solution to provide the highest level of reliability, scalability and performances on the installed mass storage system has been developed and used on the production system. The solution, called Grid Enabled Mass Storage System (GEMSS), is based on two components: a layer between the IBM GPFS and TSM HSM, and StoRM, designed to allow direct access to the storage resources by file protocol as well as standard Grid protocols. During this year, both LHC and non-LHC experiments have agreed to use GEMSS with SRM endpoint at INFN Tier-1 after the excellent results observed during their GEMSS validation phase.In this paper we describe the storage system setup, the data workflow and computing activities of the LHC experiments, and main results obtained at INFN-CNAF Tier-1 in the first year of LHC data taking. In particular, we show the system response to a sustained huge load on the mass storage system and the computing infrastructure.

show abstract

Performance Studies of the StoRM Storage Resource Manager

Cited by 18 publications

References 3 publications

StoRM: A flexible solution for Storage Resource Manager in grid

StoRM: A flexible solution for Storage Resource Manager in grid

StoRM-GPFS-TSM: A new approach to hierarchical storage management for the LHC experiments

INFN-CNAF Tier-1 Storage and Data Management Systems for the LHC Experiments

Contact Info

Product

Resources

About