C-Meter: A Framework for Performance Analysis of Computing Clouds

Abstract

Abstract-Cloud computing has emerged as a new technology that provides large amount of computing and data storage capacity to its users with a promise of increased scalability, high availability, and reduced administration and maintenance costs. As the use of cloud computing environments increases, it becomes crucial to understand the performance of these environments. So, it is of great importance to assess the performance of computing clouds in terms of various metrics, such as the overhead of acquiring and releasing the virtual computing resources, and other virtualization and network communications overheads. To address these issues, we have designed and implemented C-Meter, which is a portable, extensible, and easy-to-use framework for generating and submitting test workloads to computing clouds. In this paper, first we state the requirements for frameworks to assess the performance of computing clouds. Then, we present the architecture of the C-Meter framework and discuss several resource management alternatives. Finally, we present our early experiences with C-Meter in Amazon EC2. We show how CMeter can be used for assessing the overhead of acquiring and releasing the virtual computing resources, for comparing different configurations, for evaluating different scheduling algorithms and for determining the costs of the experiments.

Towards software performance engineering for multicore and manycore systems

“…Yet another set of challenges to measurement arises in the cloud environments, where novel metrics are adopted to characterize elasticity, and where the closed nature of the platform and the presence of competing workloads further complicates measurements [55].…”

Integrated Monitoring Approach for Seamless Service Provisioning in Federated Clouds

“…al. [15] introduced a solution for cloud performance monitoring called C-Meter. Using this framework, workloads can be submitted to target clouds to analyze their performances.…”

The mOSAIC Benchmarking Framework: Development and Execution of Custom Cloud Benchmarks

“…Papers as [14,28] propose the systematic benchmarking of clusters of virtual machines, obtained from IaaS cloud providers, and offer some interesting consideration about the performance perceived by users.…”