TY - JOUR
T1 - A reinforcement learning based multi-method approach for stochastic resource constrained project scheduling problems
AU - Sallam, Karam M.
AU - Chakrabortty, Ripon K.
AU - Ryan, Michael J.
N1 - Publisher Copyright:
© 2020 Elsevier Ltd
PY - 2021/5/1
Y1 - 2021/5/1
N2 - The Resource-Constrained Project Scheduling Problem (RCPSP) has been widely accepted as a challenging research topic due to its NP-hard nature. Because of the dynamic nature of real-world problems, stochastic-RCPSPs (SRCPSPs) are also receiving greater attention among researchers. To solve these extended RCPSPs (i.e., SRCPSPs), this paper proposes an reinforcement learning based meta-heuristic switching approach that utilizes the powers of both multi-operator differential evolution (MODE) and discrete cuckoo search (DCS) algorithms in single algorithmic framework. Reinforcement learning (RL) is introduced as a technique to select either MODE or DCS based on the diversity of population and quality of solutions. To deal with uncertain durations, a chance-constrained based approach with some belief degrees is also considered and solved by this proposed RL based multi-method approach (i.e., DECSwRL-CC). Extensive experimentation with benchmark data from the project scheduling library (PSPLIB) demonstrates the efficacy of this proposed multi-method approach. Numerous state of the art chance constrained approaches are taken from the literature to compare the proposed approach and to validate the efficacy of this multi-method approach. This particular strategy is applicable to the risk-averse decision-makers who want to realize the project schedule with a high degree of certainty.
AB - The Resource-Constrained Project Scheduling Problem (RCPSP) has been widely accepted as a challenging research topic due to its NP-hard nature. Because of the dynamic nature of real-world problems, stochastic-RCPSPs (SRCPSPs) are also receiving greater attention among researchers. To solve these extended RCPSPs (i.e., SRCPSPs), this paper proposes an reinforcement learning based meta-heuristic switching approach that utilizes the powers of both multi-operator differential evolution (MODE) and discrete cuckoo search (DCS) algorithms in single algorithmic framework. Reinforcement learning (RL) is introduced as a technique to select either MODE or DCS based on the diversity of population and quality of solutions. To deal with uncertain durations, a chance-constrained based approach with some belief degrees is also considered and solved by this proposed RL based multi-method approach (i.e., DECSwRL-CC). Extensive experimentation with benchmark data from the project scheduling library (PSPLIB) demonstrates the efficacy of this proposed multi-method approach. Numerous state of the art chance constrained approaches are taken from the literature to compare the proposed approach and to validate the efficacy of this multi-method approach. This particular strategy is applicable to the risk-averse decision-makers who want to realize the project schedule with a high degree of certainty.
KW - Cuckoo search
KW - Multi-method approach
KW - Multi-operator differential evolution
KW - Reinforcement learning
KW - Resource constrained project scheduling problems
UR - http://www.scopus.com/inward/record.url?scp=85098223590&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2020.114479
DO - 10.1016/j.eswa.2020.114479
M3 - Article
AN - SCOPUS:85098223590
SN - 0957-4174
VL - 169
SP - 1
EP - 19
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 114479
ER -