Abstract

The interrupting swap-allowed blocking job shop problem (ISBJSSP) is a complex scheduling problem that is able to model many manufacturing planning and logistics applications realistically by addressing both the lack of storage capacity and unforeseen production interruptions. Subjected to random disruptions due to machine malfunction or maintenance, industry production settings often choose to adopt dispatching rules to enable adaptive, real-time re-scheduling, rather than traditional methods that require costly re-computation on the new configuration every time the problem condition changes dynamically. To generate dispatching rules for the ISBJSSP problem, we introduce a dynamic disjunctive graph formulation characterized by nodes and edges subjected to continuous deletions and additions. This formulation enables the training of an adaptive scheduler utilizing graph neural networks and reinforcement learning. Furthermore, a simulator is developed to simulate interruption, swapping, and blocking in the ISBJSSP setting. By employing a set of reported benchmark instances, we conduct a detailed experimental study on ISBJSSP instances with a range of machine shutdown probabilities to show that the scheduling policies generated can outperform or are at least as competitive as existing dispatching rules with predetermined priority. This study shows that the ISBJSSP, which requires real-time adaptive solutions, can be scheduled efficiently with the proposed method when production interruptions occur with random machine shutdowns.

References

1.
Lange
,
J.
,
2019
, “
Solution Techniques for the Blocking Job Shop Scheduling Problem With Total Tardiness Minimization
,”
Ph.D. thesis
,
Otto-von-Guericke-Universität Magdeburg, Fakultät für Mathematik
,
Magdeburg,Germany
.
2.
D’Ariano
,
A.
,
D’Urgolo
,
P.
,
Pacciarelli
,
D.
, and
Pranzo
,
M.
,
2010
, “
13th International IEEE Conference on Intelligent Transportation Systems
,”
Optimal Sequencing of Aircrafts Take-Off and Landing at a Busy Airport
,
Funchal, Portugal
,
Sept. 19–22
,
IEEE
, pp.
1569
1574
.
3.
Pacciarelli
,
D.
, and
Pranzo
,
M.
,
2004
, “
Production Scheduling in a Steelmaking-Continuous Casting Plant
,”
Comput. Chem. Eng.
,
28
(
12
), pp.
2823
2835
.
4.
Liu
,
S. Q.
, and
Kozan
,
E.
,
2011
, “
Scheduling Trains With Priorities: A No-Wait Blocking Parallel-Machine Job-Shop Scheduling Model
,”
Transp. Sci.
,
45
(
2
), pp.
175
198
.
5.
Manne
,
A. S.
,
1960
, “
On the Job-Shop Scheduling Problem
,”
Oper. Res.
,
8
(
2
), pp.
159
294
.
6.
Lomnicki
,
Z. A.
,
1965
, “
A ‘Branch-and-Bound’ Algorithm for the Exact Solution of the Three-Machine Scheduling Problem
,”
Oper. Res. Q.
,
16
(
1
), pp.
89
100
.
7.
Gröflin
,
H.
, and
Klinkert
,
A.
,
2009
, “
A New Neighborhood and Tabu Search for the Blocking Job Shop
,”
Discret. Appl. Math.
,
157
(
17
), pp.
3643
3655
.
8.
Ahmadian
,
M. M.
,
Salehipour
,
A.
, and
Cheng
,
T. C. E.
,
2021
, “
A Meta-Heuristic to Solve the Just-in-Time Job-Shop Scheduling Problem
,”
Eur. J. Oper. Res.
,
288
(
1
), pp.
14
29
.
9.
Holthaus
,
O.
, and
Rajendran
,
C.
,
1997
, “
Efficient Dispatching Rules for Scheduling in a Job Shop
,”
Int. J. Prod. Econ.
,
48
(
1
), pp.
87
105
.
10.
Subramaniam
,
V.
,
Lee
,
G. K.
,
Hong
,
G. S.
,
Wong
,
Y. S.
, and
Ramesh
,
T.
,
2000
, “
Dynamic Selection of Dispatching Rules for Job Shop Scheduling
,”
Prod. Plan. Control.
,
11
(
1
), pp.
73
81
.
11.
Aydin
,
M. E.
, and
Öztemel
,
E.
,
2000
, “
Dynamic Job-Shop Scheduling Using Reinforcement Learning Agents
,”
Rob. Auton. Syst.
,
33
(
2–3
), pp.
169
178
.
12.
Gabel
,
T.
, and
Riedmiller
,
M.
,
2008
, “
Adaptive Reactive Job-Shop Scheduling With Reinforcement Learning Agents
,”
Int. J. Inf. Technol. Intell. Comput.
,
24
(
4
), pp.
14
18
.
13.
Mao
,
H.
,
Schwarzkopf
,
M.
,
Venkatakrishnan
,
S. B.
,
Meng
,
Z.
, and
Alizadeh
,
M.
,
2019
, “
Learning Scheduling Algorithms for Data Processing Clusters
,”
Proceedings of the ACM Special Interest Group on Data Communication
,
Beijing, China
,
Aug. 19–24
, pp.
270
288
.
14.
Wang
,
Z.
, and
Gombolay
,
M. C.
,
2020
, “
Learning Scheduling Policies for Multi-Robot Coordination With Graph Attention Networks
,”
IEEE Robot. Autom. Lett.
,
5
(
3
), pp.
4509
4516
.
15.
Waschneck
,
B.
,
Reichstaller
,
A.
,
Belzner
,
L.
,
Belzner
,
L.
,
Altenmuller
,
T.
,
Bauernhansl
,
T.
,
Knapp
,
A.
, and
Kyek
,
A.
,
2018
, “
Deep Reinforcement Learning for Semiconductor Production Scheduling
,”
29th Annual SEMI Advanced Semiconductor Manufacturing Conference
,
Saratoga Springs, NY
,
Apr. 30–May 3
, pp.
301
306
.
16.
Liu
,
C.-L.
,
Chang
,
C. C.
, and
Tseng
,
C. J.
,
2020
, “
Actor-Critic Deep Reinforcement Learning for Solving Job Shop Scheduling Problems
,”
IEEE Access
,
8
, pp.
71752
71762
.
17.
Park
,
J.
,
Chun
,
J.
,
Park
,
J.
,
Kim
,
S. H.
, and
Kim
,
Y.
,
2021
, “
Learning to Schedule Job-Shop Problems: Representation and Policy Learning Using Graph Neural Network and Reinforcement Learning
,”
Int. J. Prod. Res.
,
59
(
11
), pp.
3360
3377
.
18.
Zhang
,
C.
,
Song
,
W.
,
Cao
,
Z.
,
Zhang
,
J.
,
Tan
,
P. S.
, and
Chi
,
X.
,
2020
, “
Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learning
,”
Neural Information Processing Systems
,
Online
,
Dec. 6–12
, pp.
1621
1632
.
19.
Mascis
,
A.
, and
Pacciarelli
,
D.
,
2002
, “
Job-Shop Scheduling With Blocking and No-Wait Constraints
,”
Eur. J. Oper. Res.
,
143
(
3
), pp.
498
517
.
20.
Lawrence
,
S.
,
1984
, “
Resource Constrained Project Scheduling: An Experimental Investigation of Heuristic Scheduling Techniques (Supplement)
,”
Technical Report
,
Graduate School of Industrial Administration, Carnegie-Mellon University
,
Pittsburgh, PA
.
21.
Brizuela
,
C.
,
Zhao
,
Y.
, and
Sannomiya
,
N.
,
2001
, “
No-Wait and Blocking Job-Shops: Challenging Problems for GA’s
,”
2001 IEEE International Conference on Systems, Man and Cybernetics
,
Tucson, AZ
,
Oct. 7–10
, pp.
2349
2354
.
22.
Oddi
,
A.
,
Rasconi
,
R.
,
Cesta
,
A.
, and
Smith
,
S.
,
2012
, “
Iterative Improvement Algorithms for the Blocking Job Shop
,”
22nd International Conference on Automated Planning and Scheduling
,
Atibaia, Sao Paulo, Brazil
,
June 25–29
, pp.
199
206
.
23.
Blackstone
,
J. H.
,
Phillips
,
D. T.
, and
Hogg
,
G. L.
,
1982
, “
A State-of-the-Art Survey of Dispatching Rules for Manufacturing Job Shop Operations
,”
Int. J. Prod. Res.
,
20
(
1
), pp.
27
45
.
24.
Garey
,
M. R.
,
Johnson
,
D. S.
, and
Sethi
,
R.
,
1976
, “
The Complexity of Flowshop and Jobshop Scheduling
,”
Math. Oper. Res.
,
1
(
2
), pp.
117
129
.
25.
Schulman
,
J.
,
Wolski
,
F.
,
Dhariwal
,
P.
,
Radford
,
A.
, and
Klimov
,
O.
,
2017
, “Proximal Policy Optimization Algorithms,” arXiv preprint arXiv:1707.06347.
26.
Haykin
,
S.
,
1994
,
Neural Networks: A Comprehensive Foundation
,
Prentice Hall PTR
,
Hoboken, NJ
.
27.
Glorot
,
X.
,
Bordes
,
A.
, and
Bengio
,
Y.
,
2011
, “
Deep Sparse Rectifier Neural Networks
,”
14th International Conference on Artificial Intelligence and Statistics
,
G. J.
Gordon
,
D. B.
Dunson
, and
M.
Dudík
, eds.,
Ft. Lauderdale, FL
, pp.
315
323
.
28.
Kingma
,
D. P.
, and
Ba
,
J.
,
2015
, “
Adam: A Method for Stochastic Optimization
,” arXiv preprint arXiv:1412.6980.
You do not currently have access to this content.