A stochastic dynamic programming for maintenance planning of an emergency helicopter

References

• Antonakis, A. S., & Giannakoglou, K. C. (2018). Optimisation of military aircraft engine maintenance subject to engine part shortages using asynchronous metamodel-assisted particle swarm optimisation and monte-carlo simulations. International Journal of Systems Science: Operations & Logistics, 5(3), 239–252. https://doi.org/10.1080/23302674.2017.1289421
   Google Scholar
• Barde, S. R. A., Yacout, S., & Shin, H. (2019). Optimal preventive maintenance policy based on reinforcement learning of a fleet of military trucks. Journal of Intelligent Manufacturing, 30(1), 147–161. https://doi.org/10.1007/s10845-016-1237-7
   Web of Science ®Google Scholar
• Barlow, E., Bedford, T., Revie, M., Tan, J., & Walls, L. (2021). A performance-centred approach to optimising maintenance of complex systems. European Journal of Operational Research, 292(2), 579–595. https://doi.org/10.1016/j.ejor.2020.11.005
   Web of Science ®Google Scholar
• Berthaut, F., Gharbi, A., Kenné, J.-P., & Boulet, J.-F. (2010). Improved joint preventive maintenance and hedging point policy. International Journal of Production Economics, 127(1), 60–72. https://doi.org/10.1016/j.ijpe.2010.04.030
   Web of Science ®Google Scholar
• Cha, J. H., Finkelstein, M., & Levitin, G. (2018). Optimal mission abort policy for partially repairable heterogeneous systems. European Journal of Operational Research, 271(3), 818–825. https://doi.org/10.1016/j.ejor.2018.06.032
   Web of Science ®Google Scholar
• Chiang, J.-H., & Yuan, J. (2001). Optimal maintenance policy for a markovian system under periodic inspection. Reliability Engineering & System Safety, 71(2), 165–172. https://doi.org/10.1016/S0951-8320(00)00093-4
   Web of Science ®Google Scholar
• Cho, P., Farias, V., Kessler, J., Levi, R., Magnanti, T., & Zarybnisky, E. (2015). Maintenance and flight scheduling of low observable aircraft. Naval Research Logistics, 62(1), 60–80. https://doi.org/10.1002/nav.21614
   Web of Science ®Google Scholar
• Deng, Q., Santos, B. F., & Curran, R. (2020). A practical dynamic programming based methodology for aircraft maintenance check scheduling optimization. European Journal of Operational Research, 281(2), 256–273. https://doi.org/10.1016/j.ejor.2019.08.025
   Web of Science ®Google Scholar
• de Smidt-Destombes, K. S., van der Heijden, M. C., & van Harten, A. (2009). Joint optimisation of spare part inventory, maintenance frequency and repair capacity for k-out-of-n systems. International Journal of Production Economics, 118(1), 260–268. https://doi.org/10.1016/j.ijpe.2008.08.058
   Web of Science ®Google Scholar
• Dogramaci, A., & Fraiman, N. M. (2004). Replacement decisions with maintenance under uncertainty: An imbedded optimal control model. Operations Research, 52(5), 785–794. https://doi.org/10.1287/opre.1040.0133
   Web of Science ®Google Scholar
• Elsayed, E. A. (2021). Reliability engineering (3rd ed.). John Wiley & Sons.
   Google Scholar
• Eruguz, A. S., Tan, T., & van Houtum, G.-J. (2018). Integrated maintenance and spare part optimization for moving assets. IISE Transactions, 50(3), 230–245. https://doi.org/10.1080/24725854.2017.1312037
   Web of Science ®Google Scholar
• Gharbi, A., & Kenné, J.-P. (2000). Production and preventive maintenance rates control for a manufacturing system: An experimental design approach. International Journal of Production Economics, 65(3), 275–287. https://doi.org/10.1016/S0925-5273(99)00079-1
   Web of Science ®Google Scholar
• Ghasemi, A., Yacout, S., & Ouali, M. S. (2007). Optimal condition based maintenance with imperfect information and the proportional hazards model. International Journal of Production Research, 45(4), 989–1012. https://doi.org/10.1080/00207540600596882
   Web of Science ®Google Scholar
• Gu, J., Zhang, G., & Li, K. W. (2015). Efficient aircraft spare parts inventory management under demand uncertainty. Journal of Air Transport Management, 42, 101–109. https://doi.org/10.1016/j.jairtraman.2014.09.006
   Web of Science ®Google Scholar
• Gürler, Ü., & Kaya, A. (2002). A maintenance policy for a system with multi-state components: An approximate solution. Reliability Engineering & System Safety, 76(2), 117–127. https://doi.org/10.1016/S0951-8320(01)00125-9
   Web of Science ®Google Scholar
• Haugen, K. K. (2016). Chapter 4: SDP-difficulties. In Stochastic Dynamic Programming (pp. 59–66). University Press.
   Google Scholar
• Kim, Y.-H., & Thomas, L. C. (2013). Training and repair policies for stand-by systems. Annals of Operations Research, 208(1), 469–487. https://doi.org/10.1007/s10479-012-1185-3
   Web of Science ®Google Scholar
• Levitin, G., & Finkelstein, M. (2018). Optimal mission abort policy for systems operating in a random environment. Risk Analysis, 38(4), 795–803. https://doi.org/10.1111/risa.2018.38.issue-4
   PubMed Web of Science ®Google Scholar
• Levitin, G., Finkelstein, M., & Dai, Y. (2020a). Mission abort policy optimization for series systems with overlapping primary and rescue subsystems operating in a random environment. Reliability Engineering & System Safety, 193, 106590. https://doi.org/10.1016/j.ress.2019.106590
   Web of Science ®Google Scholar
• Levitin, G., Finkelstein, M., & Dai, Y. (2020b). State-based mission abort policies for multistate systems. Reliability Engineering & System Safety, 204, 107122. https://doi.org/10.1016/j.ress.2020.107122
   Web of Science ®Google Scholar
• Levitin, G., Finkelstein, M., & Huang, H.-Z. (2020). Optimal mission abort policies for multistate systems. Reliability Engineering & System Safety, 193, 106671. https://doi.org/10.1016/j.ress.2019.106671
   Web of Science ®Google Scholar
• Levitin, G., Finkelstein, M., & Xiang, Y. (2020). Optimal abort rules and subtask distribution in missions performed by multiple independent heterogeneous units. Reliability Engineering & System Safety, 199, 106920. https://doi.org/10.1016/j.ress.2020.106920
   Web of Science ®Google Scholar
• Levitin, G., Xing, L., & Dai, Y. (2017). Mission abort policy in heterogeneous nonrepairable 1-out-of-n warm standby systems. IEEE Transactions on Reliability, 67(1), 342–354. https://doi.org/10.1109/TR.24
   Web of Science ®Google Scholar
• Levitin, G., Xing, L., & Luo, L. (2019). Influence of failure propagation on mission abort policy in heterogeneous warm standby systems. Reliability Engineering & System Safety, 183, 29–38. https://doi.org/10.1016/j.ress.2018.11.006
   Web of Science ®Google Scholar
• Liu, Y., Chen, Y., & Jiang, T. (2020). Dynamic selective maintenance optimization for multi-state systems over a finite horizon: A deep reinforcement learning approach. European Journal of Operational Research, 283(1), 166–181. https://doi.org/10.1016/j.ejor.2019.10.049
   Web of Science ®Google Scholar
• Lugtigheid, D., Jiang, X., & A. K. S. Jardine (2008). A finite horizon model for repairable systems with repair restrictions. Journal of the Operational Research Society, 59(10), 1321–1331. https://doi.org/10.1057/palgrave.jors.2602471
   Web of Science ®Google Scholar
• Nodem, F. D., Kenné, J.-P., & Gharbi, A. (2011). Simultaneous control of production, repair/replacement and preventive maintenance of deteriorating manufacturing systems. International Journal of Production Economics, 134(1), 271–282. https://doi.org/10.1016/j.ijpe.2011.07.011
   Web of Science ®Google Scholar
• Olde Keizer, M. C. A., Teunter, R. H., & Veldman, J. (2017). Joint condition-based maintenance and inventory optimization for systems with multiple components. European Journal of Operational Research, 257(1), 209–222. https://doi.org/10.1016/j.ejor.2016.07.047
   Web of Science ®Google Scholar
• Olde Keizer, M. C. A., Teunter, R. H., Veldman, J., & Babai, M. Z. (2018). Condition-based maintenance for systems with economic dependence and load sharing. International Journal of Production Economics, 195, 319–327. https://doi.org/10.1016/j.ijpe.2017.10.030
   Web of Science ®Google Scholar
• Panagiotidou, S. (2014). Joint optimization of spare parts ordering and maintenance policies for multiple identical items subject to silent failures. European Journal of Operational Research, 235(1), 300–314. https://doi.org/10.1016/j.ejor.2013.10.065
   Web of Science ®Google Scholar
• Peng, R. (2018). Joint routing and aborting optimization of cooperative unmanned aerial vehicles. Reliability Engineering & System Safety, 177, 131–137. https://doi.org/10.1016/j.ress.2018.05.004
   Web of Science ®Google Scholar
• Powell, W. B. (2011). Approximate dynamic programming: Solving the curses of dimensionality (2nd ed.). Wiley-Blackwell.
   Google Scholar
• Powell, W. B. (2021). Reinforcement learning and stochastic optimization: A unified framework for sequential decisions. Wiley Interscience.
   Google Scholar
• Qiu, Q., & Cui, L. (2019a). Gamma process based optimal mission abort policy. Reliability Engineering & System Safety, 190, 106496. https://doi.org/10.1016/j.ress.2019.106496
   Web of Science ®Google Scholar
• Qiu, Q., & Cui, L. (2019b). Optimal mission abort policy for systems subject to random shocks based on virtual age process. Reliability Engineering & System Safety, 189, 11–20. https://doi.org/10.1016/j.ress.2019.04.010
   Web of Science ®Google Scholar
• Qiu, Q., Cui, L., & Wu, B. (2020). Dynamic mission abort policy for systems operating in a controllable environment with self-healing mechanism. Reliability Engineering & System Safety, 203, 107069. https://doi.org/10.1016/j.ress.2020.107069
   Web of Science ®Google Scholar
• Qiu, Q., Kou, M., Chen, K., Deng, Q., Kang, F., & Lin, C. (2021). Optimal stopping problems for mission oriented systems considering time redundancy. Reliability Engineering & System Safety, 205, 107226. https://doi.org/10.1016/j.ress.2020.107226
   Web of Science ®Google Scholar
• Safaei, N., Banjevic, D., & Jardine, A. K. S. (2011). Workforce-constrained maintenance scheduling for military aircraft fleet: A case study. Annals of Operations Research, 186(1), 295–316. https://doi.org/10.1007/s10479-011-0885-4
   Web of Science ®Google Scholar
• Shen, J., Cui, L., & Ma, Y. (2019). Availability and optimal maintenance policy for systems degrading in dynamic environments. European Journal of Operational Research, 276(1), 133–143. https://doi.org/10.1016/j.ejor.2018.12.029
   Web of Science ®Google Scholar
• Shi, Y., Xiang, Y., Xiao, H., & Xing, L. (2021). Joint optimization of budget allocation and maintenance planning of multi-facility transportation infrastructure systems. European Journal of Operational Research, 288(2), 382–393. https://doi.org/10.1016/j.ejor.2020.05.050
   Web of Science ®Google Scholar
• Sniedovich, M. (2011). Chapter 8: The curse of dimensionality. In Dynamic programming: Foundations and principles (2nd ed., pp. 169–182). CRC Press.
   Google Scholar
• Sun, Q., Ye, Z.-S., & Chen, N. (2017). Optimal inspection and replacement policies for multi-unit systems subject to degradation. IEEE Transactions on Reliability, 67(1), 401–413. https://doi.org/10.1109/TR.24
   Web of Science ®Google Scholar
• Vaughan, T. S. (2005). Failure replacement and preventive maintenance spare parts ordering policy. European Journal of Operational Research, 161(1), 183–190. https://doi.org/10.1016/j.ejor.2003.06.026
   Web of Science ®Google Scholar
• Wang, J., & Zhu, X. (2021). Joint optimization of condition-based maintenance and inventory control for a k-out-of-n: F system of multi-state degrading components. European Journal of Operational Research, 290(2), 514–529. https://doi.org/10.1016/j.ejor.2020.08.016
   Web of Science ®Google Scholar
• Wang, L., Chu, J., & Mao, W. (2009). A condition-based replacement and spare provisioning policy for deteriorating systems with uncertain deterioration to failure. European Journal of Operational Research, 194(1), 184–205. https://doi.org/10.1016/j.ejor.2007.12.012
   Web of Science ®Google Scholar
• Wang, W. (2012). A stochastic model for joint spare parts inventory and planned maintenance optimisation. European Journal of Operational Research, 216(1), 127–139. https://doi.org/10.1016/j.ejor.2011.07.031
   Web of Science ®Google Scholar
• Yan, T., Lei, Y., Wang, B., Han, T., Si, X., & Li, N. (2020). Joint maintenance and spare parts inventory optimization for multi-unit systems considering imperfect maintenance actions. Reliability Engineering & System Safety, 202, 106994. https://doi.org/10.1016/j.ress.2020.106994
   Web of Science ®Google Scholar
• Zhang, M., & Revie, M. (2016). Continuous-observation partially observable semi-Markov decision processes for machine maintenance. IEEE Transactions on Reliability, 66(1), 202–218. https://doi.org/10.1109/TR.2016.2626477
   Web of Science ®Google Scholar
• Zhao, X., Fan, Y., Qiu, Q., & Chen, K. (2021). Multi-criteria mission abort policy for systems subject to two-stage degradation process. European Journal of Operational Research, 295(1), 233–245. https://doi.org/10.1016/j.ejor.2021.02.043
   Web of Science ®Google Scholar
• Zhao, X., Sun, J., Qiu, Q., & Chen, K. (2021). Optimal inspection and mission abort policies for systems subject to degradation. European Journal of Operational Research, 292(2), 610–621. https://doi.org/10.1016/j.ejor.2020.11.015
   Web of Science ®Google Scholar