Predicting demand in changing environments: a review on the use of reinforcement learning in forecasting models
José Rolando Neira Villar, Miguel Angel Cano Lengua
Abstract
This systematic review, carried out under the PRISMA methodology, aims to identify how reinforcement learning has been used in demand forecasting, distinguishing the problems they are trying to overcome, recognizing the algorithms used, detailing the performance metrics used, recognizing the performance achieved by these models and identifying the business sectors in which it has been developed. Studies from all sectors were considered to expand the search range. A total of 24 articles were qualitatively analyzed, and the main results were that reinforcement learning has been used mainly for the selection or dynamic integration of the best predictors from a base of them to adapt to changing environments; whereas forecasting in volatile and complex environments is the main issue addressed; whereas Q-learning (QL), deep q network (DQN), double deep q network (DDQN), and deep deterministic policy gradient (DDPG) are the most widely used algorithms; and that, finally, the sectors of electric power, thermal energy, transport and telecommunications are the sectors where this type of forecast has been developed. Finally, given that all the models studied lack mechanisms for detecting concept drift, a new use of reinforcement learning for this purpose is proposed.
Keywords
Adaptative algorithms; Artificial intelligence; Concept drift; Demand forecasting; Reinforcement learning
DOI:
https://doi.org/10.11591/eei.v14i2.8848
Refbacks
There are currently no refbacks.
This work is licensed under a
Creative Commons Attribution-ShareAlike 4.0 International License .
<div class="statcounter"><a title="hit counter" href="http://statcounter.com/free-hit-counter/" target="_blank"><img class="statcounter" src="http://c.statcounter.com/10241695/0/5a758c6a/0/" alt="hit counter"></a></div>
Bulletin of EEI Stats
Bulletin of Electrical Engineering and Informatics (BEEI) ISSN: 2089-3191, e-ISSN: 2302-9285 This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU) .