Evaluation of delta compression techniques for efficient live migration of large virtual machines

Svärd, Petter; Hudzia, Benoît; Tordsson, Johan; Elmroth, Erik

doi:10.1145/1952682.1952698

Cited by 114 publications

(46 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although many researches have proposed novel techniques for the second phase [13]- [17], the first phase is not yet well optimized for VMs that treat large data. This problem must be solved because the first and the second phases are equally important since they both transfer large number of memory pages.…”

Section: Technical Details Of Live Migrationmentioning

confidence: 99%

Fast Live Migration for IO-Intensive VMs with Parallel and Adaptive Transfer of Page Cache via SAN

Akiyama

Hirofuchi

Takano

et al. 2016

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYLive migration plays an important role on improving efficiency of cloud data centers by enabling dynamically replacing virtual machines (VMs) without disrupting services running on them. Although many studies have proposed acceleration mechanisms of live migration, IO-intensive VMs still suffer from long total migration time due to a large amount of page cache. Existing studies for this problem either force the guest OS to delete the page cache before a migration, or they do not consider dynamic characteristics of cloud data centers. We propose a parallel and adaptive transfer of page cache for migrating IO-intensive VMs which (1) does not delete the page cache and is still fast by utilizing the storage area network of a data center, and (2) achieves the shortest total migration time without tuning hand-crafted parameters. Experiments showed that our method reduces total migration time of IO-intensive VMs up to 33.9%.

show abstract

Section: Technical Details Of Live Migrationmentioning

confidence: 99%

Fast Live Migration for IO-Intensive VMs with Parallel and Adaptive Transfer of Page Cache via SAN

Akiyama

Hirofuchi

Takano

et al. 2016

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

show abstract

“…According to the time locality principle of the program, a previous dirty page will likely continue to be changed later and, therefore, we adopt the least recent used (LRU) page replacement algorithm. FITDOC borrows ideas from the RLE [20] data compression method and improves upon them. The schematic diagram of delta memory compression is illustrated in Fig.…”

Section: Delta Memory Compressionmentioning

confidence: 99%

“…In [20], Svard et al study the application of delta compression during the transfer of memory pages to increase migration throughput and thus reduce downtime, and they achieve better performance. However, they do not quantitatively analyze the changed bytes in dirty pages.…”

Section: Related Workmentioning

confidence: 99%

FITDOC: fast virtual machines checkpointing with delta memory compression

Shi

Jin

et al. 2015

J Supercomput

View full text Add to dashboard Cite

Virtualization provides the function of saving the entire status of the execution environment of a running virtual machine (VM), which makes checkpointing flexible and practical for HPC servers or data center servers. However, the systemlevel checkpointing needs to save a large number of data to the disk. Moreover, the overhead grows linearly with the increasing size of virtual machine memory, which leads to disk I/O consumption disaster along with poor system scalability. To target this, we propose a novel fast VM checkpointing approach, named Fast Incremental checkpoinTing with Delta memOry Compression (FITDOC). By studying the runtime memory characteristics of different workloads, FITDOC counts the dirty pages in a fine-granularity manner (i.e., the number of 8 bytes), instead of in the conventional method (i.e., the number of pages). FITDOC utilises a dirty page logging mechanism to record the dirty pages. Accordingly, a delta memory compression mechanism is implemented to eliminate redundant memory data in checkpointing files. To locate the dirty data in dirty pages, FITDOC utilizes two mechanisms: by analyzing the distribution characteristics of dirty pages in the dirty bitmap, we propose a fast dirty bitmap scanning method to locate the dirty pages, and take a multi-threading data comparison mechanism to locate the real dirty data in one page. The experimental results show that compared with Xen's default system-level checkpointing algorithm, FITDOC can on average reduce checkpointing time 70.54 % with a 1 GB memory size A preliminary version containing some of the results in this paper has been published in the CSE 2014. 123Y. Du et al. and achieve better improvement for VMs with larger memory configurations. FITDOC can reduce the size of checkpointing data 52.88 % on average compared with Remus's incremental solution, which is in page granularity. Compared with the default dirty bitmap scanning method in Xen, the scanning time of FITDOC is decreased by 91.13 % on average.

show abstract

“…However, since VM migration is a resource-intensive process, application performance is significantly affected during migration (Barhamet al, 2003;Clark et al, 2005;Xu et al, 2014). Bandwidth optimization techniques such as deduplication, compression, write-throttling, and dynamic rate-limiting optimize bandwidth utilization efficiency to enhance application performance (Deshpande et al, 2012;Gerofi et al, 2011, Hirofuchi et al, 2010Sahni and Varma, 2012;Svärd et al, 2011). Furthermore, VM migration techniques migrate VMs either within LAN or WAN boundaries.…”

Section: Introductionmentioning

confidence: 99%

A survey on virtual machine migration and server consolidation frameworks for cloud data centers

Ahmad

Gani

Hamid

et al. 2015

Journal of Network and Computer Applications

321

120

View full text Add to dashboard Cite

Evaluation of delta compression techniques for efficient live migration of large virtual machines

Cited by 114 publications

References 13 publications

Fast Live Migration for IO-Intensive VMs with Parallel and Adaptive Transfer of Page Cache via SAN

Fast Live Migration for IO-Intensive VMs with Parallel and Adaptive Transfer of Page Cache via SAN

FITDOC: fast virtual machines checkpointing with delta memory compression

A survey on virtual machine migration and server consolidation frameworks for cloud data centers

Contact Info

Product

Resources

About