File Type and Access Pattern Aware Buffer Cache Management for Rendering Systems

Shin, Dong‐Hee; Cho, Kyungwoon; Bahn, Hyokyung

doi:10.3390/electronics9010164

Cited by 6 publications

(4 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As our traces were captured at the instruction level memory references, they have complicated nested loops, which are difficult to be described through a single characteristic like file access patterns [21]. Thus, we focus on the characteristics of the workloads with respect to the locality of references.…”

Section: Analysis and Modeling Of Memory Access Timementioning

confidence: 99%

Modeling and Analysis of the Page Sizing Problem for NVM Storage in Virtualized Systems

Park

Bahn

2021

IEEE Access

Self Cite

View full text Add to dashboard Cite

Recently, NVM (non-volatile memory) has advanced as a fast storage medium, and traditional memory management systems designed for HDD storage should be reconsidered. In this article, we revisit the page sizing problem in NVM storage, specially focusing on virtualized systems. The page sizing problem has not caught attention in traditional systems because of the two reasons. First, the memory performance is not sensitive to the page size when HDD is adopted as storage. We show that this is not the case in NVM storage by analyzing the TLB miss rate and the page fault rate, which have trade-off relations with respect to the page size. Second, changing the page size in traditional systems is not easy as it accompanies significant overhead. However, due to the widespread adoption of virtualized systems, the page sizing problem becomes feasible for virtual machines, which are generated for executing specific workloads with fixed hardware resources. In this article, we design a page size model that accurately estimates the TLB miss rate and the page fault rate for NVM storage. We then present a method that has the ability of estimating the memory access time as the page size is varied, which can guide a suitable page size for given environments. By considering workload characteristics with given memory and storage resources, we show that the memory performance of virtualized systems can be improved by 38.4% when our model is adopted.

show abstract

Section: Analysis and Modeling Of Memory Access Timementioning

confidence: 99%

Modeling and Analysis of the Page Sizing Problem for NVM Storage in Virtualized Systems

Park

Bahn

2021

IEEE Access

Self Cite

View full text Add to dashboard Cite

show abstract

“…Once the dictionary has no capacity to record new entries, it generally deletes all the contents of the dictionary and re-creates the dictionary. However, SSD is a kind of data storage device and the data stored in SSD has a certain locality in time [20,21]. This means that, although the current data may not be matched, after a period of time, new data may be matched.…”

Section: Data Compressionmentioning

confidence: 99%

ZDC: A Zone Data Compression Method for Solid State Drive Based Flash Memory

Zhai

2020

Symmetry

View full text Add to dashboard Cite

Solid-state drive (SSD) with flash memory as the storage medium are being widely used in various data storage systems. SSD data compression means that data is compressed before it is written to Not-And (NAND) Flash. Data compression can reduce the amount of data written in NAND Flash and improve the performance and reliability of SSDs. At present, the main problem facing data compression of SSD is how to improve the efficiency of data compression and decompression. In order to improve the performance of data compression and decompression, this study proposes a method of SSD data deduplication based on zone division. First, this study divides the storage space of the SSD into zones and divides them into one hot zone and multiple cold zones according to the different erasing frequency. Second, the data in each zone is divided into hot data and cold data according to the number of erasures. At the same time, the address mapping table in the hot zone is loaded into the cache. Finally, when there is a write or read request, the SSD will selectively compress or decompress the data according to the type of different zones. Through simulation tests, the correctness and effectiveness of this study are verified. The research results show that the data compression rate of this research result can reach 70-95%. Compared with SSD without data compression, write amplification is reduced by 5 to 30%, and write latency is reduced by 5 to 25%. The research results have certain reference value for improving the performance and reliability of SSD.

show abstract

“…Rendering is the process of creating high-resolution photorealistic or non-photorealistic images from a 2D or 3D geometric model by making use of computer software [1,2,3]. Rendering is widely used to generate scenes for animations, video games, simulations, and visual effects in movies, where a scene consists of more than 24 frames per second.…”

Section: Introductionmentioning

confidence: 99%

Design and Implementation of a Distributed Versioning File System for Cloud Rendering

Cho

Bahn²

2021

IEEE Access

Self Cite

View full text Add to dashboard Cite

Rendering is widely used for visual effects in animations, video games, and movies. As the computational load in rendering workloads fluctuates greatly over time, it is attractive to use cloud infrastructures for cost-effective rendering. However, we analyze that cloud rendering has several technical challenges involved in the handling of rendering input data. In this article, we analyze the workload characteristics of popular rendering projects, and find out the following three observations. First, total size of rendering input files reaches tens to hundreds of gigabytes, and uploading these large data to cloud increases the startup latency of rendering significantly. Second, the consistency requirement of file systems in cloud rendering is complicated compared to that of traditional distributed file systems. Third, file accesses in rendering are highly skewed such that the top 20% files account for 60-80% of total accesses, whereas 40-70% are never used or used only once. Based on these observations, we design and implement a new file system for cloud rendering, which has the function of version control, on-demand fetch, and distributed cooperative caching for rendering data. This allows for minimizing data transmission overhead caused by the large input data of rendering and satisfying the rendering data consistency. Measurement studies under synthetic and real workloads show that the proposed file system performs better than the conventional uploading scheme and NFS by 55.4% and 29.5% on average, respectively.

show abstract

File Type and Access Pattern Aware Buffer Cache Management for Rendering Systems

Cited by 6 publications

References 17 publications

Modeling and Analysis of the Page Sizing Problem for NVM Storage in Virtualized Systems

Modeling and Analysis of the Page Sizing Problem for NVM Storage in Virtualized Systems

ZDC: A Zone Data Compression Method for Solid State Drive Based Flash Memory

Design and Implementation of a Distributed Versioning File System for Cloud Rendering

Contact Info

Product

Resources

About