Share:


A method integrating simulation and reinforcement learning for operation scheduling in container terminals

    Qingcheng Zeng Affiliation
    ; Zhongzhen Yang Affiliation
    ; Xiangpei Hu Affiliation

Abstract

The objective of operation scheduling in container terminals is to determine a schedule that minimizes time for loading or unloading a given set of containers. This paper presents a method integrating reinforcement learning and simulation to optimize operation scheduling in container terminals. The introduced method uses a simulation model to construct the system environment while the Q-learning algorithm (reinforcement learning algorithm) is applied to learn optimal dispatching rules for different equipment (e.g. yard cranes, yard trailers). The optimal scheduling scheme is obtained by the interaction of the Q-learning algorithm and simulation environment. To evaluate the effectiveness of the proposed method, a lower bound is calculated considering the characteristics of the scheduling problem in container terminals. Finally, numerical experiments are provided to illustrate the validity of the proposed method.


First Published Online: 09 Jan 2012

Keyword : container terminals, scheduling, simulation, reinforcement learning

How to Cite
Zeng, Q., Yang, Z., & Hu, X. (2011). A method integrating simulation and reinforcement learning for operation scheduling in container terminals. Transport, 26(4), 383-393. https://doi.org/10.3846/16484142.2011.638022
Published in Issue
Dec 31, 2011
Abstract Views
652
PDF Downloads
540
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.