Predicting demand in changing environments: a review on the use of reinforcement learning in forecasting models

José Rolando Neira Villar, Miguel Angel Cano Lengua

Abstract


This systematic review, carried out under the PRISMA methodology, aims to identify how reinforcement learning has been used in demand forecasting, distinguishing the problems they are trying to overcome, recognizing the algorithms used, detailing the performance metrics used, recognizing the performance achieved by these models and identifying the business sectors in which it has been developed. Studies from all sectors were considered to expand the search range. A total of 24 articles were qualitatively analyzed, and the main results were that reinforcement learning has been used mainly for the selection or dynamic integration of the best predictors from a base of them to adapt to changing environments; whereas forecasting in volatile and complex environments is the main issue addressed; whereas Q-learning (QL), deep q network (DQN), double deep q network (DDQN), and deep deterministic policy gradient (DDPG) are the most widely used algorithms; and that, finally, the sectors of electric power, thermal energy, transport and telecommunications are the sectors where this type of forecast has been developed. Finally, given that all the models studied lack mechanisms for detecting concept drift, a new use of reinforcement learning for this purpose is proposed.

Keywords


Adaptative algorithms; Artificial intelligence; Concept drift; Demand forecasting; Reinforcement learning

Full Text:

PDF


DOI: https://doi.org/10.11591/eei.v14i2.8848

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Bulletin of EEI Stats

Bulletin of Electrical Engineering and Informatics (BEEI)
ISSN: 2089-3191, e-ISSN: 2302-9285
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).