Object Storage: The Future Building Block for Storage Systems A Position Paper

Factor, Michael; Meth, Kalman; Naor, Dalit; Rodeh, Ohad; Satran, J.

doi:10.1109/lgdi.2005.1612479

Cited by 88 publications

(40 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The T10 standards [8], [19] were proposed to store data and attributes as objects. Based on T10 standards, Seagate, IBM (ObjectStore [7]), and Panasas (PanFS [25]) implemented prototypes [19] and demonstrated the capability of object-based storage systems.…”

Section: Related Workmentioning

confidence: 99%

Toward Transparent Data Management in Multi-Layer Storage Hierarchy of HPC Systems

Wadhwa

Byna

Butt

2018

2018 IEEE International Conference on Cloud Engineering (IC2E)

View full text Add to dashboard Cite

Abstract-Upcoming exascale high performance computing (HPC) systems are expected to comprise multi-tier storage hierarchy, and thus will necessitate innovative storage and I/O mechanisms. Traditional disk and block-based interfaces and file systems face severe challenges in utilizing capabilities of storage hierarchies due to the lack of hierarchy support and semantic interfaces. Object-based and semantically-rich data abstractions for scientific data management on large scale systems offer a sustainable solution to these challenges. Such data abstractions can also simplify users involvement in data movement. In this paper, we take the first steps of realizing such an object abstraction and explore storage mechanisms for these objects to enhance I/O performance, especially for scientific applications. We explore how an object-based interface can facilitate next generation scalable computing systems by presenting the mapping of data I/O from two real world HPC scientific use cases: a plasma physics simulation code (VPIC) and a cosmology simulation code (HACC). Our storage model stores data objects in different physical organizations to support data movement across layers of memory/storage hierarchy. Our implementation sclaes well to 16K parallel processes, and compared to the state of the art, such as MPI-IO and HDF5, our object-based data abstractions and data placement strategy in multi-level storage hierarchy achieves up to 7× I/O performance improvement for scientific data.

show abstract

Section: Related Workmentioning

confidence: 99%

Toward Transparent Data Management in Multi-Layer Storage Hierarchy of HPC Systems

Wadhwa

Byna

Butt

2018

2018 IEEE International Conference on Cloud Engineering (IC2E)

View full text Add to dashboard Cite

show abstract

“…Ventana's is featured by its versioning, isolation, and encapsulation properties to support virtualization. The file system of Ventana is implemented using an object store technique [18]. Each version of a file's data or metadata is stored as an object.…”

Section: Related Workmentioning

confidence: 99%

VMStore: Distributed storage system for multiple virtual machines

Liao

Jin

et al. 2011

Sci. China Inf. Sci.

View full text Add to dashboard Cite

Desktop virtualization is a very hot concept in both industry and academic communities. Since virtualized desktop system is based on multiple virtual machines (VM), it is necessary to design a distributed storage system to manage the VM images. In this paper, we design a distributed storage system, VMStore, by taking into account three important characteristics: high performance VM snapshot, booting optimization from multiple images and redundancy removal of images data. We adopt a direct index structure of blocks for VM snapshots to speed up VM booting performance significantly; provide a distribute storage structure with good bandwidth scalability by dynamically changing the number of storage nodes; and propose a data preprocessing strategy with intelligent object partitioning techniques, which would eliminate duplication more effectively. Performance analysis for VMStore focuses on two metrics: the speedup of VM booting and the overhead of de-duplication. Experimental results show the efficiency and effectiveness of VMStore.

show abstract

“…MOBBS is based on objectbased storage which is highly scalable for storing unstructured data like VMDIs through allowing direct data accessing from clients to storage nodes called OSDs (Object-based Storage Devices) [7]. Moreover, due to the inherent characteristics of object-based storage which stripes data into a set of partitions, it possesses a great potential to be the infrastructure of multitiered storage systems aiming to achieve efficient utilization of multiple storage devices.…”

Section: Introductionmentioning

confidence: 99%

MOBBS: A Multi-tiered Block Storage System for Virtual Machines Using Object-Based Storage

Chen

et al. 2014

2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security

View full text Add to dashboard Cite

The recent decade witnesses the prevalence of hybrid storage systems that offer storage based on diverse storage devices to achieve both cost savings and performance improvements. However, there have been little of studies focusing on the challenging scenario of providing hybrid block storage for Virtual Machines (VMs), which is subject to several stringent requirements such as availability and scalability. To bridge this gap, we designed and implemented a multi-tiered storage system called MOBBS which provides hybrid block storage for VMs on top of object-based storage infrastructure. MOBBS achieves efficient utilization of different storage devices by striping data into partitions and intelligently determining appropriate data placement by monitoring and analyzing real-time workloads. Moveover, leveraging the benefits of object-based storage, several techniques are designed to promise storage provisioning for VMs with high availability and scalability. A Ceph implementation of MOBBS is evaluated using both block and file system workloads. The results demonstrate the effectiveness and efficiency of MOBBS in utilization of different storage devices.

show abstract

Object Storage: The Future Building Block for Storage Systems A Position Paper

Cited by 88 publications

References 4 publications

Toward Transparent Data Management in Multi-Layer Storage Hierarchy of HPC Systems

Toward Transparent Data Management in Multi-Layer Storage Hierarchy of HPC Systems

VMStore: Distributed storage system for multiple virtual machines

MOBBS: A Multi-tiered Block Storage System for Virtual Machines Using Object-Based Storage

Contact Info

Product

Resources

About