Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs

Bolosky, William J.; Douceur, John R.; Ely, David P.; Theimer, Marvin

doi:10.1145/339331.339345

Cited by 311 publications

(220 citation statements)

References 29 publications

Supporting

Mentioning

217

Contrasting

Unclassified

Order By: Relevance

“…From the large body of research already dedicated to modeling the availability of parallel and distributed computer systems-see [19,17,18,9] and the references within-, relatively little attention has been given to space-correlated errors and failures [19,4,11], despite their reported importance [8,17]. The main differences between this work and the previous work on space-correlated errors and failures is summarized in Table 12.…”

Section: Related Workmentioning

confidence: 98%

“…However, few studies [19,4,11] investigate the bursty arrival of failures for distributed systems. Even for these studies, the findings are based on data corresponding to a single system-until the recent creation of online repositories such as the failure Failure Trace Archive [13] and the Computer Failure Data Repository [18], failure data for distributed systems were largely inaccessible to the researchers in this area.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A Model for Space-Correlated Failures in Large-Scale Distributed Systems

Gallet¹,

Yigitbasi²,

Javadi³

et al. 2010

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Distributed systems such as grids, peer-to-peer systems, and even Internet DNS servers have grown significantly in size and complexity in the last decade. This rapid growth has allowed distributed systems to serve a large and increasing number of users, but has also made resource and system failures inevitable. Moreover, perhaps as a result of system complexity, in distributed systems a single failure can trigger within a short time span several more failures, forming a group of time-correlated failures. To eliminate or alleviate the significant effects of failures on performance and functionality, the techniques for dealing with failures require good failure models. However, not many such models are available, and the available models are valid for few or even a single distributed system. In contrast, in this work we propose a model that considers groups of time-correlated failures and is valid for many types of distributed systems. Our model includes three components, the group size, the group inter-arrival time, and the resource downtime caused by the group. To validate this model, we use failure traces corresponding to fifteen distributed systems. We find that space-correlated failures are dominant in terms of resource downtime in seven of the fifteen studied systems. For each of these seven systems, we provide a set of model parameters that can be used in research studies or for tuning distributed systems. Last, as a result of our work six of the studied traces have been made available through the Failure Trace Archive

show abstract

Section: Related Workmentioning

confidence: 98%

Section: Introductionmentioning

confidence: 99%

A Model for Space-Correlated Failures in Large-Scale Distributed Systems

Gallet¹,

Yigitbasi²,

Javadi³

et al. 2010

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

“…• Corporate Desktop PCs -We used the data collected by Bolosky et al [6] on their study of the availability of 51,663 desktop PCs at Microsoft Corporation over the course of 35 days by pinging a fixed set of machines every hour.…”

Section: Measured Dynamics and Availabilitymentioning

confidence: 99%

High Availability in DHTs: Erasure Coding vs. Replication

Rodrigues

Liskov²

2005

Peer-to-Peer Systems IV

282

233

View full text Add to dashboard Cite

show abstract

“…But storing users' data on the third party storage potentially risks with security and privacy concerns, while the study [17] shows that the desktop and office computers possessed by an average user is enough to store the data owned by the user.…”

Section: Related Workmentioning

confidence: 99%

vUPS: Virtually Unifying Personal Storage for Fast and Pervasive Data Accesses

Hassan

Bhattarai

Chen

2013

Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

View full text Add to dashboard Cite

Abstract. More and more overlapping functions on all kinds of mobile devices with these on traditional computers have significantly expanded the usage of mobile devices in our daily life. This also causes the demand surge of pervasively and quickly accessing files across different personal devices owned by a user. Most existing solutions, such as DropBox and SkyDrive, rely on some centralized infrastructure (e.g., cloud storage) to synchronize files across different devices. Therefore, these solutions come with potential risks of user privacy and data secrecy. In addition, continuously maintaining strong consistency among multiple replicas of a file is very costly. On the other hand, today a common user often owns sufficiently large storage space across her personal home desktop, office computer, and mobile devices. Therefore, in this paper, we aim to design and implement a system to virtually Unify Personal Storage (vUPS) for fast and pervasive accesses of personal data across different devices. vUPS provides similar services as offered by existing cloud-based storage services, but (1) vUPS consists of only personal computers without involving any third party, thus it minimizes the risks of user privacy and data secrecy; (2) vUPS organizes all storage in a distributed fashion so that it is not prone to the single point of failure; (3) vUPS differentiates files and maintains different consistency policies in order to reduce the consistency maintenance cost. Having implemented vUPS with HTML5, we conduct extensive experiments to evaluate its performance. The results show that vUPS offers similar user performance when compared to DropBox.

show abstract

Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs

Cited by 311 publications

References 29 publications

A Model for Space-Correlated Failures in Large-Scale Distributed Systems

A Model for Space-Correlated Failures in Large-Scale Distributed Systems

High Availability in DHTs: Erasure Coding vs. Replication

vUPS: Virtually Unifying Personal Storage for Fast and Pervasive Data Accesses

Contact Info

Product

Resources

About