Impact of Link Failures on the Performance of MapReduce in Data Center Networks

Sanaa Hamid Mohamed; Taisir E.H. El-Gorashi; Jaafar M.H. Elmirghani

doi:10.1109/ICTON.2018.8473964

Impact of Link Failures on the Performance of MapReduce in Data Center Networks

Sanaa Hamid Mohamed
, Taisir E.H. El-Gorashi
, Jaafar M.H. Elmirghani

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

3 Citations (Scopus)

Abstract

In this paper, we utilize Mixed Integer Linear Programming (MILP) models to determine the impact of link failures on the performance of shuffling operations in MapReduce when different data center network (DCN) topologies are used. For a set of non-fatal single and multi-links failures, the results indicate that different DCNs experience different completion time degradations ranging between 5% and 40%. The best performance under links failures is achieved by a server-centric PON-based DCN.

Original language	English
Title of host publication	2018 20th International Conference on Transparent Optical Networks, ICTON 2018
Place of Publication	United States
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	1-4
Number of pages	4
ISBN (Electronic)	9781538666043
ISBN (Print)	9781538666050
DOIs	https://doi.org/10.1109/ICTON.2018.8473964
Publication status	Published - 26 Sept 2018
Externally published	Yes
Event	20th International Conference on Transparent Optical Networks, ICTON 2018 - Bucharest, Romania Duration: 1 Jul 2018 → 5 Jul 2018

Publication series

Name	International Conference on Transparent Optical Networks
Volume	2018-July
ISSN (Electronic)	2162-7339

Conference

Conference	20th International Conference on Transparent Optical Networks, ICTON 2018
Country/Territory	Romania
City	Bucharest
Period	1/07/18 → 5/07/18

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 7 Affordable and Clean Energy

Access to Document

10.1109/ICTON.2018.8473964

Cite this

Mohamed, S. H., El-Gorashi, T. E. H., & Elmirghani, J. M. H. (2018). Impact of Link Failures on the Performance of MapReduce in Data Center Networks. In 2018 20th International Conference on Transparent Optical Networks, ICTON 2018 (pp. 1-4). Article 8473964 (International Conference on Transparent Optical Networks; Vol. 2018-July). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICTON.2018.8473964

Mohamed, Sanaa Hamid ; El-Gorashi, Taisir E.H. ; Elmirghani, Jaafar M.H. / Impact of Link Failures on the Performance of MapReduce in Data Center Networks. 2018 20th International Conference on Transparent Optical Networks, ICTON 2018. United States : IEEE, Institute of Electrical and Electronics Engineers, 2018. pp. 1-4 (International Conference on Transparent Optical Networks).

@inproceedings{12cfbe817d0b4da8b0ab6314623df4df,

title = "Impact of Link Failures on the Performance of MapReduce in Data Center Networks",

abstract = "In this paper, we utilize Mixed Integer Linear Programming (MILP) models to determine the impact of link failures on the performance of shuffling operations in MapReduce when different data center network (DCN) topologies are used. For a set of non-fatal single and multi-links failures, the results indicate that different DCNs experience different completion time degradations ranging between 5\% and 40\%. The best performance under links failures is achieved by a server-centric PON-based DCN.",

keywords = "completion time, data center networking (DCN), energy efficiency, MapReduce, passive optical networks (PON), resilience",

author = "Mohamed, \{Sanaa Hamid\} and El-Gorashi, \{Taisir E.H.\} and Elmirghani, \{Jaafar M.H.\}",

note = "Funding Information: The authors would like to acknowledge funding from the Engineering and Physical Sciences Research Council (EPSRC), through INTERNET (EP/H040536/1) and STAR (EP/K016873/1) projects. The first author would like to acknowledge EPSRC for funding her PhD programme of study. All data are provided in full in the results section of this paper. Publisher Copyright: {\textcopyright} 2018 IEEE.; 20th International Conference on Transparent Optical Networks, ICTON 2018 ; Conference date: 01-07-2018 Through 05-07-2018",

year = "2018",

month = sep,

day = "26",

doi = "10.1109/ICTON.2018.8473964",

language = "English",

isbn = "9781538666050",

series = "International Conference on Transparent Optical Networks",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

pages = "1--4",

booktitle = "2018 20th International Conference on Transparent Optical Networks, ICTON 2018",

address = "United States",

}

Mohamed, SH, El-Gorashi, TEH & Elmirghani, JMH 2018, Impact of Link Failures on the Performance of MapReduce in Data Center Networks. in 2018 20th International Conference on Transparent Optical Networks, ICTON 2018., 8473964, International Conference on Transparent Optical Networks, vol. 2018-July, IEEE, Institute of Electrical and Electronics Engineers, United States, pp. 1-4, 20th International Conference on Transparent Optical Networks, ICTON 2018, Bucharest, Romania, 1/07/18. https://doi.org/10.1109/ICTON.2018.8473964

Impact of Link Failures on the Performance of MapReduce in Data Center Networks. / Mohamed, Sanaa Hamid; El-Gorashi, Taisir E.H.; Elmirghani, Jaafar M.H.
2018 20th International Conference on Transparent Optical Networks, ICTON 2018. United States: IEEE, Institute of Electrical and Electronics Engineers, 2018. p. 1-4 8473964 (International Conference on Transparent Optical Networks; Vol. 2018-July).

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

TY - GEN

T1 - Impact of Link Failures on the Performance of MapReduce in Data Center Networks

AU - Mohamed, Sanaa Hamid

AU - El-Gorashi, Taisir E.H.

AU - Elmirghani, Jaafar M.H.

N1 - Funding Information: The authors would like to acknowledge funding from the Engineering and Physical Sciences Research Council (EPSRC), through INTERNET (EP/H040536/1) and STAR (EP/K016873/1) projects. The first author would like to acknowledge EPSRC for funding her PhD programme of study. All data are provided in full in the results section of this paper. Publisher Copyright: © 2018 IEEE.

PY - 2018/9/26

Y1 - 2018/9/26

N2 - In this paper, we utilize Mixed Integer Linear Programming (MILP) models to determine the impact of link failures on the performance of shuffling operations in MapReduce when different data center network (DCN) topologies are used. For a set of non-fatal single and multi-links failures, the results indicate that different DCNs experience different completion time degradations ranging between 5% and 40%. The best performance under links failures is achieved by a server-centric PON-based DCN.

AB - In this paper, we utilize Mixed Integer Linear Programming (MILP) models to determine the impact of link failures on the performance of shuffling operations in MapReduce when different data center network (DCN) topologies are used. For a set of non-fatal single and multi-links failures, the results indicate that different DCNs experience different completion time degradations ranging between 5% and 40%. The best performance under links failures is achieved by a server-centric PON-based DCN.

KW - completion time

KW - data center networking (DCN)

KW - energy efficiency

KW - MapReduce

KW - passive optical networks (PON)

KW - resilience

UR - https://www.scopus.com/pages/publications/85055513390

UR - http://icton2018.upb.ro/

UR - https://www.itl.waw.pl/pl/icton2018

U2 - 10.1109/ICTON.2018.8473964

DO - 10.1109/ICTON.2018.8473964

M3 - Conference contribution

AN - SCOPUS:85055513390

SN - 9781538666050

T3 - International Conference on Transparent Optical Networks

SP - 1

EP - 4

BT - 2018 20th International Conference on Transparent Optical Networks, ICTON 2018

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - United States

T2 - 20th International Conference on Transparent Optical Networks, ICTON 2018

Y2 - 1 July 2018 through 5 July 2018

ER -

Mohamed SH, El-Gorashi TEH, Elmirghani JMH. Impact of Link Failures on the Performance of MapReduce in Data Center Networks. In 2018 20th International Conference on Transparent Optical Networks, ICTON 2018. United States: IEEE, Institute of Electrical and Electronics Engineers. 2018. p. 1-4. 8473964. (International Conference on Transparent Optical Networks). doi: 10.1109/ICTON.2018.8473964

Impact of Link Failures on the Performance of MapReduce in Data Center Networks

Abstract

Publication series

Conference

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this