A Parallel distributed genetic algorithm using Apache Spark for flexible scheduling of multitasks in a cloud manufacturing environment

ABSTRACT

Cloud manufacturing is one of the modern manufacturing systems that aim to control and manage production processes through a cloud platform to optimize the usage of resources and achieve customer objectives. Scheduling large-scale problems with diversity in the required tasks and the available services is a significant challenge for any researcher, especially with the possibility of recurring dynamic events, such as the arrival of new tasks. Thus, our first objective is to present a mixed-integer mathematical model that demonstrates the complexity of scheduling problems in a dynamic CMfg environment. We developed a parallel distributed genetic algorithm (PDGA) for optimizing large-scale scheduling problems on Apache Spark. The PDGA adopts a resilient distributed dataset (RDD) to improve the decomposition of the population and also enhance both the performance and the speed of the evolution process. The PDGA then updates the schedule by using a greedy strategy to improve the overall performance. To verify the effectiveness of the PDGA, we evaluated the algorithm on a benchmark and generated 8 large-scale problems based on this benchmark. The experiments show that the PDGA provides better performance and lower computational time compared to the traditional genetic algorithm and particle swarm optimization algorithm.

KEYWORDS:

• cloud manufacturing
• dynamic arrival of tasks
• Apache spark
• parallel distributed genetic algorithm
• mathematical modeling
• scheduling

Acknowledgment

This work is supported by Scientific and Technological Innovation 2030 - New Generation Artificial Intelligence Major Project of China (2022ZD0115404). Also, the first author acknowledges the support provided by the China Scholarship Council to obtain a doctorate degree under Grant number 2018BSZ007009.

Disclosure statement

No potential conflict of interest was reported by the author(s).