Q-learning algorithm for resource allocation in WDMA-based optical wireless communication networks

Abdelrahman S. Elgamal, Osama Z. Alsulami, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi, Jaafar M.H. Elmirghani

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

2 Citations (Scopus)

Abstract

Visible Light Communication (VLC) has been widely investigated during the last decade due to its ability to provide high data rates with low power consumption. In general, resource management is an important issue in cellular networks that can highly effect their performance. In this paper, an optimisation problem is formulated to assign each user to an optimal access point and a wavelength at a given time. This problem can be solved using mixed integer linear programming (MILP). However, using MILP is not considered a practical solution due to its complexity and memory requirements. In addition, accurate information must be provided to perform the resource allocation. Therefore, the optimisation problem is reformulated using reinforcement learning (RL), which has recently received tremendous interest due to its ability to interact with any environment without prior knowledge. In this paper, the resource allocation optimisation problem in VLC systems is investigated using the basic Q-learning algorithm. Two scenarios are simulated to compare the results with the previously proposed MILP model. The results demonstrate the ability of the Q-learning algorithm to provide optimal solutions close to the MILP model without prior knowledge of the system.

Original languageEnglish
Title of host publication2021 6th International Conference on Smart and Sustainable Technologies, SpliTech 2021
EditorsPetar Solic, Sandro Nizetic, Joel J. P. C. Rodrigues, Joel J.P.C. Rodrigues, Diego Lopez-de-Ipina Gonzalez-de-Artaza, Toni Perkovic, Luca Catarinucci, Luigi Patrono
Place of PublicationUnited States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1-5
Number of pages5
ISBN (Electronic)9789532901122
ISBN (Print)9781665442022
DOIs
Publication statusPublished - 8 Sep 2021
Externally publishedYes
Event6th International Conference on Smart and Sustainable Technologies, SpliTech 2021 - Bol and Split, Croatia
Duration: 8 Sep 202111 Sep 2021

Publication series

Name2021 6th International Conference on Smart and Sustainable Technologies, SpliTech 2021

Conference

Conference6th International Conference on Smart and Sustainable Technologies, SpliTech 2021
Country/TerritoryCroatia
CityBol and Split
Period8/09/2111/09/21

Fingerprint

Dive into the research topics of 'Q-learning algorithm for resource allocation in WDMA-based optical wireless communication networks'. Together they form a unique fingerprint.

Cite this