Analysis of Performance Variability in Public Cloud Computing

Jamie ERICSON, Masoud MOHAMMADIAN, Fabiana SANTANA

Research output: A Conference proceeding or a Chapter in BookConference contribution

1 Citation (Scopus)

Abstract

Recent reports on cloud computing performance have provided anecdotal evidence to suggest that it varies over time and according to the vendor. This variability could potentially detract from customer experience, and/or result in increased costs to cloud consumers. In order to investigate performance variability over time, this research measured a number of different services provided by five of the major vendors over one month period. The same benchmarks were executed against a dedicated non-cloud system to establish a baseline. Preliminary results showed that not all vendors offer consistent performance over time. While the performance in disk access was relatively stable, high variability in RAM latency and CPU performance was observed in some cases. They suggest that performance variability should be considered when evaluating vendors, perhaps even incorporated to SLAs. This would ensure that vendors are providing the performance stability to match the resources provided, enabling adequate capacity planning and cost control.
Original languageEnglish
Title of host publication2017 IEEE International Conference on Information Reuse and Integration Proceedings
EditorsLatifur Khan, Balaji Palanisamy, Chengcui Zhang, Sahra Sedigh Sarvestani
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages308-314
Number of pages7
ISBN (Electronic)9781538615621
ISBN (Print)9781538615621
DOIs
Publication statusPublished - 2017

Fingerprint

Cloud computing
Random access storage
Program processors
Costs
Planning

Cite this

ERICSON, J., MOHAMMADIAN, M., & SANTANA, F. (2017). Analysis of Performance Variability in Public Cloud Computing. In L. Khan, B. Palanisamy, C. Zhang, & S. S. Sarvestani (Eds.), 2017 IEEE International Conference on Information Reuse and Integration Proceedings (pp. 308-314). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/IRI.2017.47
ERICSON, Jamie ; MOHAMMADIAN, Masoud ; SANTANA, Fabiana. / Analysis of Performance Variability in Public Cloud Computing. 2017 IEEE International Conference on Information Reuse and Integration Proceedings. editor / Latifur Khan ; Balaji Palanisamy ; Chengcui Zhang ; Sahra Sedigh Sarvestani. IEEE, Institute of Electrical and Electronics Engineers, 2017. pp. 308-314
@inproceedings{26cf9f2bac0b40ea837a0c120b2d9180,
title = "Analysis of Performance Variability in Public Cloud Computing",
abstract = "Recent reports on cloud computing performance have provided anecdotal evidence to suggest that it varies over time and according to the vendor. This variability could potentially detract from customer experience, and/or result in increased costs to cloud consumers. In order to investigate performance variability over time, this research measured a number of different services provided by five of the major vendors over one month period. The same benchmarks were executed against a dedicated non-cloud system to establish a baseline. Preliminary results showed that not all vendors offer consistent performance over time. While the performance in disk access was relatively stable, high variability in RAM latency and CPU performance was observed in some cases. They suggest that performance variability should be considered when evaluating vendors, perhaps even incorporated to SLAs. This would ensure that vendors are providing the performance stability to match the resources provided, enabling adequate capacity planning and cost control.",
keywords = "Analysis of performance variability, Cloud computing, Noisy neighbour, Public clouds",
author = "Jamie ERICSON and Masoud MOHAMMADIAN and Fabiana SANTANA",
year = "2017",
doi = "10.1109/IRI.2017.47",
language = "English",
isbn = "9781538615621",
pages = "308--314",
editor = "Latifur Khan and Balaji Palanisamy and Chengcui Zhang and Sarvestani, {Sahra Sedigh}",
booktitle = "2017 IEEE International Conference on Information Reuse and Integration Proceedings",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",
address = "United States",

}

ERICSON, J, MOHAMMADIAN, M & SANTANA, F 2017, Analysis of Performance Variability in Public Cloud Computing. in L Khan, B Palanisamy, C Zhang & SS Sarvestani (eds), 2017 IEEE International Conference on Information Reuse and Integration Proceedings. IEEE, Institute of Electrical and Electronics Engineers, pp. 308-314. https://doi.org/10.1109/IRI.2017.47

Analysis of Performance Variability in Public Cloud Computing. / ERICSON, Jamie; MOHAMMADIAN, Masoud; SANTANA, Fabiana.

2017 IEEE International Conference on Information Reuse and Integration Proceedings. ed. / Latifur Khan; Balaji Palanisamy; Chengcui Zhang; Sahra Sedigh Sarvestani. IEEE, Institute of Electrical and Electronics Engineers, 2017. p. 308-314.

Research output: A Conference proceeding or a Chapter in BookConference contribution

TY - GEN

T1 - Analysis of Performance Variability in Public Cloud Computing

AU - ERICSON, Jamie

AU - MOHAMMADIAN, Masoud

AU - SANTANA, Fabiana

PY - 2017

Y1 - 2017

N2 - Recent reports on cloud computing performance have provided anecdotal evidence to suggest that it varies over time and according to the vendor. This variability could potentially detract from customer experience, and/or result in increased costs to cloud consumers. In order to investigate performance variability over time, this research measured a number of different services provided by five of the major vendors over one month period. The same benchmarks were executed against a dedicated non-cloud system to establish a baseline. Preliminary results showed that not all vendors offer consistent performance over time. While the performance in disk access was relatively stable, high variability in RAM latency and CPU performance was observed in some cases. They suggest that performance variability should be considered when evaluating vendors, perhaps even incorporated to SLAs. This would ensure that vendors are providing the performance stability to match the resources provided, enabling adequate capacity planning and cost control.

AB - Recent reports on cloud computing performance have provided anecdotal evidence to suggest that it varies over time and according to the vendor. This variability could potentially detract from customer experience, and/or result in increased costs to cloud consumers. In order to investigate performance variability over time, this research measured a number of different services provided by five of the major vendors over one month period. The same benchmarks were executed against a dedicated non-cloud system to establish a baseline. Preliminary results showed that not all vendors offer consistent performance over time. While the performance in disk access was relatively stable, high variability in RAM latency and CPU performance was observed in some cases. They suggest that performance variability should be considered when evaluating vendors, perhaps even incorporated to SLAs. This would ensure that vendors are providing the performance stability to match the resources provided, enabling adequate capacity planning and cost control.

KW - Analysis of performance variability

KW - Cloud computing

KW - Noisy neighbour

KW - Public clouds

UR - http://www.scopus.com/inward/record.url?scp=85044239383&partnerID=8YFLogxK

UR - http://www.mendeley.com/research/analysis-performance-variability-public-cloud-computing

U2 - 10.1109/IRI.2017.47

DO - 10.1109/IRI.2017.47

M3 - Conference contribution

SN - 9781538615621

SP - 308

EP - 314

BT - 2017 IEEE International Conference on Information Reuse and Integration Proceedings

A2 - Khan, Latifur

A2 - Palanisamy, Balaji

A2 - Zhang, Chengcui

A2 - Sarvestani, Sahra Sedigh

PB - IEEE, Institute of Electrical and Electronics Engineers

ER -

ERICSON J, MOHAMMADIAN M, SANTANA F. Analysis of Performance Variability in Public Cloud Computing. In Khan L, Palanisamy B, Zhang C, Sarvestani SS, editors, 2017 IEEE International Conference on Information Reuse and Integration Proceedings. IEEE, Institute of Electrical and Electronics Engineers. 2017. p. 308-314 https://doi.org/10.1109/IRI.2017.47