Fast replication in content distribution overlays

Ganguly, Samrat; Saxena, Akhilesh; Bhatnagar, Sudeept; Izmailov, Rauf; Banerjee, Sujata

doi:10.1109/infcom.2005.1498512

Cited by 32 publications

(29 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To add flexibility, various peer-to-peer data distribution solutions split files into blocks and transfer these blocks independently (e.g., BitTorrent [11], Bullet [12], SPIDER [30] and many other systems). Much like the aforementioned applicationlevel routing, this approach allows applications a greater degree of control over data distribution.…”

Section: Data Partitioningmentioning

confidence: 99%

Beyond Music Sharing: An Evaluation of Peer-to-Peer Data Dissemination Techniques in Large Scientific Collaborations

et al. 2008

View full text Add to dashboard Cite

The avalanche of data from scientific instruments and the ensuing interest from geographically distributed users to analyze and interpret it accentuates the need for efficient data dissemination. A suitable data distribution scheme will find the delicate balance between conflicting requirements of minimizing transfer times, minimizing the impact on the network, and uniformly distributing load among participants. We identify several data distribution techniques, some successfully employed by today's peer-to-peer networks: staging, data partitioning, orthogonal bandwidth exploitation, and combinations of the above.We use simulations to explore the performance of these techniques in contexts similar to those used by today's data-centric scientific collaborations and derive several recommendations for efficient data dissemination. Our experimental results show that the peer-to-peer solutions that offer load balancing and good fault tolerance properties and have embedded participation incentives lead to unjustified costs in today's scientific data collaborations deployed on over-provisioned network cores. However, as user communities grow and these deployments scale, peer-to-peer data delivery mechanisms will likely outperform other techniques.

show abstract

Section: Data Partitioningmentioning

confidence: 99%

Beyond Music Sharing: An Evaluation of Peer-to-Peer Data Dissemination Techniques in Large Scientific Collaborations

et al. 2008

View full text Add to dashboard Cite

show abstract

“…When providing data dissemination functionality, overlays often serve as support for extracting dissemination trees used to send data from each source to all destinations. Among the solutions in this category sit: application level multicasting ALM [5], which constructs an overlay tree between participating end-nodes which is then used to disseminate data, and Spider [4], which builds multiple source-rooted trees.…”

Section: Data Dissemination Solutionsmentioning

confidence: 99%

A Simulation Study of Data Distribution Strategies for Large-Scale Scientific Data Collaborations

Kiswany

Ripeanu

2007

2007 Canadian Conference on Electrical and Computer Engineering

View full text Add to dashboard Cite

Abstract. Scientific instruments in fields as diverse as high-energy physics and genomics generate enormous volumes of data that need to be processed and analyzed by geographically dispersed communities. Such scientific collaborations require an efficient data dissemination technique. We analyze recent techniques proposed for peer-to-peer data distribution, select a small set of solutions representative for the various approaches currently proposed, and evaluate them, through simulation, in the context of data dissemination in scientific collaborations. This paper focuses on the performance and scalability of our simulator. Additionally, we include several preliminary recommendations for data optimal dissemination in data-intensive scientific collaborations derived form our preliminary simulation results.

show abstract

“…But the performance of overlay changes with time as nodes dynamically join and leave the system. [19] proposed an overlay CDN architecture where a set of intermediaries act as TNs, which organize themselves into a content delivery overlay and are used to replicate and forward data Our work can be used in both in conventional CDNs and the improved Overlay CDNs. In this paper, it focuses on how to maintain the Web consistency and reduce the network traffic caused by consistency management in content delivery overlay.…”

Section: Content Delivery Overlaysmentioning

confidence: 99%

“…More recently, some other researchers have also advocated using an overlay CDN structure composed of dedicated transit nodes to distribute the large contents [19].…”

Section: Introductionmentioning

confidence: 99%

Scalable Maintenance for Strong Web Consistency in Dynamic Content Delivery Overlays

Katto

Yasuda

2007

2007 IEEE International Conference on Communications

View full text Add to dashboard Cite

Abstract-Content Delivery Overlays improves end-user performance by replicating Web contents on a group of geographically distributed sites interconnected over the Internet. However, with the development whereby overlay systems can manage dynamically changing files, an important issue to be resolved is consistency management, which means the cached replicas on different sites must be updated if the originals change. In this paper, based on the analytical formulation of object freshness, web access distribution and network topology, we derive a novel algorithm as follows: (1) For a given content which has been changed on its original server, only a limited number of its replicas instead of all replicas are updated. (2) After a replica has been selected for update, the latest version will be sent from an algorithm-decided site instead of from its original server. Simulation results verify that the proposed algorithm provides much better consistency management than conventional methods with the reduced the hit ratio and network traffic.Index Terms-content delivery networks, consistency algorithm, web cache performance, network traffic

show abstract

Fast replication in content distribution overlays

Cited by 32 publications

References 31 publications

Beyond Music Sharing: An Evaluation of Peer-to-Peer Data Dissemination Techniques in Large Scientific Collaborations

Beyond Music Sharing: An Evaluation of Peer-to-Peer Data Dissemination Techniques in Large Scientific Collaborations

A Simulation Study of Data Distribution Strategies for Large-Scale Scientific Data Collaborations

Scalable Maintenance for Strong Web Consistency in Dynamic Content Delivery Overlays

Contact Info

Product

Resources

About