An active storage framework for object storage devices

Runde, Michael T.; Stevens, Wesley G.; Wortman, Paul A.; Chandy, John A.

doi:10.1109/msst.2012.6232372

Cited by 11 publications

(12 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We plan to do more detailed evaluations and to implement gecmember _attributes with multiple 110 servers in future work. We also plan to lever age active storage [13], [1], [16], [17] and communication between object-storage servers for further improvement.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Optimizations on the Parallel Virtual File System implementation integrated with Object-Based Storage Devices

Karakoyunlu

Chandy

2013

2013 IEEE International Conference on Cluster Computing (CLUSTER)

Self Cite

View full text Add to dashboard Cite

Object-Based Storage Devices (OSDs) offer an object-based data layout instead of using the traditional block based design. Object storage ideas are increasingly being used in parallel file systems and cloud storage. Previous work has implemented the Parallel Virtual File System (PVFS) on OSDs by moving the metadata and data operations to the OSDs. In this paper, we present two new methods to further improve the performance of the existing PVFS-OSD implementation. These methods are using object collections to represent traditional directories on OSDs and delaying the creation of an OSD object until it is accessed by a write operation. The optimization methods are not particular to PVFS-OSD implementation and could be used with other parallel file systems-object storage implementations too. Experimental evaluations show that using collections yields up to 29 times of improvement in throughput; whereas delaying the creation of OSD objects provides 25 % throughput improvement.

show abstract

Section: Discussionmentioning

confidence: 99%

“…It is a good candidate for realizing active storage [13], [1], [16], [17], since it is possible to encapsulate computations inside objects. OSD+ [4] presents an object storage model that adds dedicated directory objects to no OSD standard [19].…”

Section: Related Workmentioning

confidence: 99%

Optimizations on the Parallel Virtual File System implementation integrated with Object-Based Storage Devices

Karakoyunlu

Chandy

2013

2013 IEEE International Conference on Cluster Computing (CLUSTER)

Self Cite

View full text Add to dashboard Cite

show abstract

“…In this section, we propose the active storage framework we constructed [35] on the OSC-OSD target [9] and the openosd OSD initiator maintained by Panasas. Since both OSC-OSD and open-osd are open-source, and open-osd has been included in the Linux kernel, it is an ideal platform to build our work.…”

Section: Current Active Storage Frameworkmentioning

confidence: 99%

Using an Object-Based Active Storage Framework to Improve Parallel Storage Systems

Karakoyunlu

Runde

Chandy

2014

2014 43rd International Conference on Parallel Processing Workshops

Self Cite

View full text Add to dashboard Cite

Modern processors have improved rapidly over recent decades and disk storage has failed to keep pace with this development rate. Object-based storage was proposed as an alternative interface in order to close the gap between the processing units and the storage components. Object-based storage simplifies data representation and increases the intelligence of storage components by offloading data management tasks from the host filesystem to the storage. However, we believe that objectbased storage features have not been fully explored. In this work, we first introduce an active storage framework we developed for an object-based storage platform. Specifically, we show how to enable active storage by exploiting the object-based storage features. Then, we discuss how the active storage framework can be used in order to improve the scalability, reliability and usability of parallel storage systems.

show abstract

“…Primitive script management associates scripts with function objects, but the project does not address high-level management challenges. Runde, et al [11] use sandboxing virtualization technology to isolate server-side computations, but do not address any type of logical isolation necessary to build the workspace abstraction we have proposed.…”

Section: Related Workmentioning

confidence: 99%

In-vivo Storage System Development

Watkins

Maltzahn

Brandt

et al. 2014

Euro-Par 2013: Parallel Processing Workshops

View full text Add to dashboard Cite

Abstract. The emergence of high-performance open-source storage systems is allowing application and middleware developers to consider nonstandard storage system interfaces. In contrast to the practice of virtually always designing for file-like byte-stream interfaces, co-designed domainspecific storage system interfaces are becoming increasingly common. However, in order for developers to evolve interfaces in high-availability storage systems, services are needed for in-vivo interface evolution that allows the development of interfaces in the context of a live system. Current clustered storage systems that provide interface customizability expose primitive services for managing ad-hoc interfaces. For maximum utility, the ability to create, evolve, and deploy dynamic storage interfaces is needed. However, in large-scale clusters, dynamic interface instantiation will require system-level support that ensures interface version consistency among storage nodes and client applications. We propose that storage systems should provide services that fully manage the life-cycle of dynamic interfaces that are aligned with the common branchand-merge form of software maintenance, including isolated development workspaces that can be combined into existing production views of the system.

show abstract

An active storage framework for object storage devices

Cited by 11 publications

References 15 publications

Optimizations on the Parallel Virtual File System implementation integrated with Object-Based Storage Devices

Optimizations on the Parallel Virtual File System implementation integrated with Object-Based Storage Devices

Using an Object-Based Active Storage Framework to Improve Parallel Storage Systems

In-vivo Storage System Development

Contact Info

Product

Resources

About