Improving Server Performance on Multi-cores via Selective Off-Loading of OS Functionality

Abstract

Abstract. Modern and future server-class processors will incorporate many cores. Some studies have suggested that it may be worthwhile to dedicate some of the many cores for specific tasks such as operating system execution. OS off-loading has two main benefits: improved performance due to better cache utilization and improved power efficiency due to smarter use of heterogeneous cores. However, OS off-loading is a complex process that involves balancing the overheads of off-loading against the potential benefit, which is unknown while making the offloading decision. In prior work, OS off-loading has been implemented by first profiling system call behavior and then manually instrumenting some OS routines (out of hundreds) to support off-loading. We propose a hardware-based mechanism to help automate the off-load decisionmaking process, and provide high quality dynamic decisions via performance feedback. Our mechanism dynamically estimates the off-load requirements of the application and relies on a run-length predictor for the upcoming OS system call invocation. The resulting hardware based off-loading policy yields a throughput improvement of up to 18% over a baseline without off-loading, 13% over a static software based policy, and 23% over a dynamic software based policy.

A file I/O system for many-core based clusters

“…In addition, Nellans et al [9] propose a hardware-based offload decision making mechanism and show that it contributes to a performance improvement.…”

“…In order to solve this issue, it has been proposed that system calls are performed on different core, solely dedicated to OS functionality [13,15,7,8,9]. In this paper, such a core is called as an OS function core, distinct from a computing core.…”