Storage for Advanced Scientific Use-Cases and Beyond

Millar, Paul; Adeyemi, Olufemi; Behrmann, Gerd; Fuhrmann, Patrick; Garonne, V.; Litvinsev, Dmitry; Mkrtchyan, T.; Rossi, Albert; Sahakyan, Marina; Starek, Jürgen

doi:10.1109/pdp2018.2018.00109

Cited by 2 publications

(1 citation statement)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Subsequently, a SRM + HTTP-TPC solution was put in place to replace SRM + GridFTP [4] in Tier-1 tape-endpoints. This process occurred in 2020/2021 and required site-issued tokens (most widely used implementation being macaroons [16]) plus support in FTS/Gfal2 and SEs [17]. Tape operations still had be done with SRM bringOnline [2].…”

Section: Previous Workmentioning

confidence: 99%

An HTTP REST API for Tape-backed Storage

Afonso,

Caffy,

Patrascoiu

et al. 2024

EPJ Web of Conf.

View full text Add to dashboard Cite

The goal of the HTTP REST API for Tape project is to provide a simple, minimalistic and uniform interface to manage data transfers between Storage Endpoints (SEs) where the source file is on tape. The project is a collaboration between the developers of WLCG storage systems (EOS+CTA, dCache, StoRM) and data transfer clients (gfal2, FTS). For some years, HTTP has been growing in popularity as the preferred data transfer protocol between many WLCG SEs. However — unlike other protocols such as XRootD and SRM — HTTP does not include a method to stage files from tape to disk prior to transfer, forcing the use of workarounds such as hybrid protocols (different protocols used for the “stage” and “transfer” parts of the operation). The HTTP REST API offers a simple and consistent solution, by extending the HTTP protocol to include staging operations. It provides clients with a common and consistent API across different storage systems to manage and monitor the disk and tape residency of stored files. In this contribution, we present the history and motivation of the HTTP REST API project, the specification of version 1 of the API and implementation details in the various storage and data transfer systems. We also describe our experience of its deployment and use for LHC Run-3 operations. We conclude with a discussion of possible future work.

show abstract

Section: Previous Workmentioning

confidence: 99%

An HTTP REST API for Tape-backed Storage

Afonso,

Caffy,

Patrascoiu

et al. 2024

EPJ Web of Conf.

View full text Add to dashboard Cite

show abstract

Ethics, Digital Rights Management, and Cyber Security

Hussain

Kiah

2021

Applied Ethics in a Digital World

View full text Add to dashboard Cite

Cloud content hosting and redistribution is enabling convenient and easy access to online content thereby accelerating the adoption and penetration of internet in past two decades. The current Industry 4.0 revolution and adoption and acceleration efforts are leveraging cloud computing as a means to store, retrieve, and share data. This makes the internet a relatively vulnerable to content abuse and increase the demand of clear consent before data consumption and redistribution. The growth of cloud computing and management technologies is penetrating in the market, and digital rights management (DRM) practices are needed for better and ethically safe online space. This chapter talks about state-of-the-art DRM paradigms being proposed in the literature and critically discusses their technical performance, flexibility, and immutability challenges. This chapter will clarify internet governance implementation roadmap for Industry 4.0 revolution by critically analyzing the cloud technology stack and ethical features by advocating Cloud DRM.

show abstract

Storage for Advanced Scientific Use-Cases and Beyond

Cited by 2 publications

References 17 publications

An HTTP REST API for Tape-backed Storage

An HTTP REST API for Tape-backed Storage

Ethics, Digital Rights Management, and Cyber Security

Contact Info

Product

Resources

About