Why simheuristics?benefits, limitations, and best practices when combining metaheuristics with simulation

  1. Manuel Chica
  2. Angel A. Juan
  3. Christopher Bayliss
  4. Oscar Cordón
  5. W. David Kelton
Revista:
Sort: Statistics and Operations Research Transactions

ISSN: 1696-2281

Año de publicación: 2020

Volumen: 44

Número: 2

Páginas: 311-334

Tipo: Artículo

Otras publicaciones en: Sort: Statistics and Operations Research Transactions

Resumen

Many decision-making processes in our society involve NP-hard optimization problems. The largescale, dynamism, and uncertainty of these problems constrain the potential use of stand-alone optimization methods. The same applies for isolated simulation models, which do not have the potential to find optimal solutions in a combinatorial environment. This paper discusses the utilization of modelling and solving approaches based on the integration of simulation with metaheuristics. These ‘simheuristic’ algorithms, which constitute a natural extension of both metaheuristics and simulation techniques, should be used as a ‘first-resort’ method when addressing large-scale and NP-hard optimization problems under uncertainty –which is a frequent case in real-life applications. We outline the benefits and limitations of simheuristic algorithms, provide numerical experiments that validate our arguments, review some recent publications, and outline the best practices to consider during their design and implementation stages

Referencias bibliográficas

  • Andradóttir, S. (2006). An overview of simulation optimization via random search. Handbooks in Operations Research and Management Science, 13, 617–631.
  • Anter, A. M. and Ali, M. (2020). Feature selection strategy based on hybrid crow search optimization algorithm integrated with chaos theory and fuzzy c-means algorithm for medical diagnosis problems. Soft Computing, 24, 1565–1584.
  • April, J., Glover, F., Kelly, J. P. and Laguna, M. (2003). Simulation-based optimization: practical introduction to simulation optimization. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 71–78. IEEE.
  • April, J., Better, M., Glover, F., Kelly, J. and Laguna, M. (2006). Enhancing business process management with simulation optimization. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 642–649. IEEE.
  • Beyer, H.-G. and Sendhoff, B. (2007). Robust optimization–a comprehensive survey. Computer Methods in Applied Mechanics and Engineering, 196, 3190–3218.
  • Bhatnagar, S., Fu, M. C., Marcus, S. I. and Wang, I.-J. (2003). Two-timescale simultaneous perturbation stochastic approximation using deterministic perturbation sequences. ACM Transactions on Modeling and Computer Simulation, 13, 180–209.
  • Bonissone, P. P., Subbu, R. and Lizzi, J. (2009). Multicriteria decision making: a framework for research and applications. IEEE Computational Intelligence Magazine, 4, 48–61.
  • Boschetti, M. A., Maniezzo, V., Roffilli, M. and Röhler, A. B. (2009). Matheuristics: optimization, simulation and control. In Hybrid Metaheuristics, pp. 171–177. Springer.
  • Cabrera, G., Juan, A. A., Lázaro, D., Marquès, J. M. and Proskurnia, I. (2014). A simulation-optimization approach to deploy internet services in large-scale systems with user-provided resources. Simulation, 90, 644–659.
  • Calvet, L., Wang, D., Juan, A. A. and Bové, L. (2019). Solving the multidepot vehicle routing problem with limited depot capacity and stochastic demands. International Transactions in Operational Research, 26, 458–484.
  • Chau, M., Fu, M. C., Qu, H. and Ryzhov ,I. O. (2014). Simulation optimization: a tutorial overview and recent developments in gradient-based methods. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 21–35. IEEE.
  • Chica, M., Barranquero, J., Kajdanowicz, T., Cordón, O. and Damas, S. (2017). Multimodal optimization: an effective framework for model calibration. Information Sciences, 375, 79–97.
  • Chica, M., Bautista, J., Cordón, Ó. and Damas, S. (2016). A multiobjective model and evolutionary algorithms for robust time and space assembly line balancing under uncertain demand. Omega, 58, 55–68.
  • Couture, R.-M., Moe, S. J., Lin, Y., Kaste, Ø., Haande, S. and Solheim, A. L. (2018). Simulating water quality and ecological status of Lake Vansjø, Norway, under land-use and climate change by linking process-oriented models with a Bayesian network. Science of the Total Environment, 621, 713–724.
  • De Armas, J., Juan, A. A., Marquès, J. M. and Pedroso, J. P. (2017). Solving the deterministic and stochastic uncapacitated facility location problem: from a heuristic to a simheuristic. Journal of the Operational Research Society, 68, 1161–1176.
  • Deb, K., Bandaru, S., Greiner, D., Gaspar-Cunha, A. and Tutum, C. C. (2014). An integrated approach to automated innovization for discovering useful design principles: case studies from engineering. Applied Soft Computing, 15, 42–56.
  • Djanatliev, A. and German, R. (2013). Prospective healthcare decision-making by combined system dynamics, discrete-event and agent-based simulation. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 270–281. IEEE.
  • Dokeroglu, T., Sevinc, E., Kucukyilmaz, T. and Cosar, A. (2019). A survey on new generation metaheuristic algorithms. Computers & Industrial Engineering, 137, 106040.
  • Dorigo, M. and Stützle, T. (2004). Ant Colony Optimization. MIT Press, Cambridge.
  • Faulin, J., Juan, A. A., Serrat, C. and Bargueno, V. (2008). Predicting availability functions in timedependent complex systems with saedes simulation algorithms. Reliability Engineering & System Safety, 93, 1761–1771.
  • Feo, T. A. and Resende, M. G. C. (1995). Greedy randomized adaptive search procedures. Journal of Global Optimization, 6, 109–133.
  • Ferone, D., Gruler, A., Festa, P. and Juan, A. A. (2019). Enhancing and extending the classical GRASP framework with biased randomisation and simulation. Journal of the Operational Research Society, 70, 1362–1375.
  • Figueira, G. and Almada-Lobo, B. (2014). Hybrid simulation–optimization methods: a taxonomy and discussion. Simulation Modelling Practice and Theory, 46, 118–134.
  • Fischetti, M. and Fischetti, M. (2018). Matheuristics. In Handbook of Heuristics, pp. 121–153. Springer.
  • Forrester, J. W. (2007). System dynamics: the next fifty years. System Dynamics Review, 23, 359–370.
  • Fu, M. C. (2002). Optimization for simulation: theory vs. practice. INFORMS Journal on Computing, 14, 192–215.
  • Fu, M. C. (2015). Handbook of Simulation Optimization, Volume 216. Springer.
  • Glover, F., Kelly, J. P. and Laguna, M. (1996). New advances and applications of combining simulation and optimization. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 144–152. IEEE.
  • Glover, F., Kelly, J. P. and Laguna, M. (1999). New advances for wedding optimization and simulation. In Proceedings of the Winter Simulation Conference, Volume 1, Piscataway, New Jersey, pp. 255–260. IEEE.
  • Glover, F. and Laguna, M. (2013). Tabu search. In Handbook of Combinatorial Optimization, pp. 3261– 3362. Springer.
  • Glover, F. W. and Kochenberger, G. A. (2006). Handbook of Metaheuristics, Volume 57. Springer Science & Business Media.
  • Gonzalez-Martin, S., Juan, A. A., Riera, D., Elizondo, M. G. and Ramos, J. J. (2018). A simheuristic algorithm for solving the arc routing problem with stochastic demands. Journal of Simulation, 12, 53– 66.
  • Gonzalez-Neira, E. M., Ferone, D., Hatami, S. and Juan, A. A. (2017). A biased-randomized simheuristic for the distributed assembly permutation flowshop problem with stochastic processing times. Simulation Modelling Practice and Theory, 79, 23–36.
  • Gosavi, A. (2015). Simulation-Based Optimization. Springer US, New York.
  • Gruler, A., de Armas, J., Juan, A. A. and Goldsman, D. (2019). Modelling human network behaviour using simulation and optimization tools: the need for hybridization. SORT-Statistics and Operations Research Transactions, 43, 0193–222.
  • Gruler, A., Fikar, C., Juan, A. A., Hirsch, P. and Contreras-Bolton, C. (2017a). Supporting multi-depot and stochastic waste collection management in clustered urban areas via simulation–optimization. Journal of simulation, 11, 11–19.
  • Gruler, A., Panadero, J., de Armas, J., Moreno, J. A. and Juan, A. A. (2020a). A variable neighbourhood search simheuristic for the multiperiod inventory routing problem with stochastic demands. International Transactions in Operational Research, 27, 314–335.
  • Gruler, A., A. Perez-Navarro, L. Calvet, and A. A. Juan (2020b). A simheuristic algorithm for timedependent waste collection management with stochastic travel times. SORT-Statistics and Operations Research Transactions, 44, 1–29.
  • Gruler, A., Quintero, C. L., Calvet, L. and Juan, A. A. (2017b). Waste collection under uncertainty: a simheuristic based on variable neighbourhood search. European Journal of Industrial Engineering, 11, 228–255.
  • Hansen, P., Mladenović, N. and Moreno, J. A. (2010). Variable neighbourhood search: methods and applications. Annals of Operations Research, 175, 367–407.
  • Hatami, S., Calvet, L., Fernández-Viagas, V., Framiñán, J. M. and Juan, A. A. (2018). A simheuristic algorithm to set up starting times in the stochastic parallel flowshop problem. Simulation Modelling Practice and Theory, 86, 55–71.
  • Heath, S. K., Buss, A., Brailsford, S. C. and Macal, C. M. (2011). Cross-paradigm simulation modelling: challenges and successes. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 2788–2802. IEEE.
  • Hubscher-Younger, T., Mosterman, P. J., DeLand, S., Orqueda, O. and Eastman, D. (2012). Integrating discrete-event and time-based models with optimization for resource allocation. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 1–15. IEEE.
  • Hussain, K., Salleh, M. N. M., Cheng, S. and Shi, Y. (2019). Metaheuristic research: a comprehensive survey. Artificial Intelligence Review, 52, 2191–2233.
  • Jian, N. and Henderson, S. G. (2015). An introduction to simulation optimization. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 1780–1794. IEEE.
  • Juan, A., Faulin, J., Grasman, S., Riera, D., Marull, J. and Mendez, C. (2011). Using safety stocks and simulation to solve the vehicle routing problem with stochastic demands. Transportation Research Part C: Emerging Technologies, 19, 751–765.
  • Juan, A. A., Corlu, C. G., Tordecilla, R. D., de la Torre, R. and Ferrer, A. (2020). On the use of biasedrandomized algorithms for solving non-smooth optimization problems. Algorithms, 13, 8.
  • Juan, A. A., Grasman, S. E., Caceres-Cruz, J. and Bektaş, T. (2014). A simheuristic algorithm for the single-period stochastic inventory-routing problem with stock-outs. Simulation Modelling Practice and Theory, 46, 40–52.
  • Juan, A. A., Kelton, W. D., Currie, C. S. and Faulin, J. (2018). Simheuristics applications: dealing with uncertainty in logistics, transportation, and other supply chain areas. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 3048–3059. IEEE.
  • Kasaie, P. and Kelton, W. D. (2015). Guidelines for design and analysis in agent-based simulation studies. In Proceedings of the Winter Simulation Conference, Piscataway, New Jersey, pp. 183–193. IEEE.
  • Keith, A. J. and Ahner, D. K. (2019). A survey of decision making and optimization under uncertainty. Annals of Operations Research, SI, 1–35.
  • Kelton, W. D., Sadowski, R. and Zupick, N. B. (2015). Simulation with Arena (6th Edition). McGraw-Hill Education.
  • Kennedy, J. (2010). Particle swarm optimization. In Encyclopedia of Machine Learning, pp. 760–766. Springer.
  • Kirkpatrick, S.,Gelatt, J. C. D. and Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220, 671–680.
  • Kleijnen, J. P., Sanchez, S. M., Lucas, T. W. and Cioppa, T. M. (2005). State-of-the-art review: a user’s guide to the brave new world of designing simulation experiments. INFORMS Journal on Computing, 17, 263–289.
  • Kleijnen, J. P. and Wan, J. (2007). Optimization of simulated systems: OptQuest and alternatives. Simulation Modelling Practice and Theory, 15, 354–362.
  • Laguna, M. and Marti, R. (2012). Scatter Search: Methodology and Implementations in C, Volume 24. Springer Science & Business Media.
  • Larranaga, P. and Lozano, J. A. (2002). Estimation of Distribution Algorithms: a New Tool for Evolutionary Computation, Volume 2. Springer Science & Business Media.
  • Lee, C. K. H. (2018). A review of applications of genetic algorithms in operations management. Engineering Applications of Artificial Intelligence, 76, 1–12.
  • Li, L., Jafarpour, B. and Mohammad-Khaninezhad, M. R. (2013). A simultaneous perturbation stochastic approximation algorithm for coupled well placement and control optimization under geologic uncertainty. Computational Geosciences, 17, 167–188.
  • Ligmann-Zielinska, A., Kramer, D. B., Cheruvelil, K. S. and Soranno, P. A. (2014). Using uncertainty and sensitivity analyses in socioecological agent-based models to improve their analytical performance and policy relevance. PloS one, 9, e109779.
  • Lourenço, H. R., Martin, O. C. and Stützle, T. (2010). Iterated local search: framework and applications. In Handbook of Metaheuristics, pp. 363–397. Springer.
  • Lucas, T. W., Kelton, W. D., Sánchez, P. J., Sanchez, S. M. and Anderson, B. L. (2015). Changing the paradigm: simulation, now a method of first resort. Naval Research Logistics, 62, 293–303.
  • Melani, A. H., Murad, C. A., Caminada Netto, A., Souza, G. F. and Nabeta, S. I. (2019). Maintenance strategy optimization of a coal-fired power plant cooling tower through generalized stochastic Petri nets. Energies, 12, 1951.
  • Miettinen, K. (2014). Survey of methods to visualize alternatives in multiple criteria decision making problems. OR Spectrum, 36, 3–37.
  • Morecroft, J. (2007). Strategic Modelling and Business Dynamics: A Feedback Systems Approach. John Wiley & Sons.
  • Moscato, P. and Mathieson, L. (2019). Memetic algorithms for business analytics and data science: a brief survey. In Business and Consumer Analytics: New Ideas, pp. 545–608. Springer.
  • Oliva, R. (2003). Model calibration as a testing strategy for system dynamics models. European Journal of Operational Research, 151, 552–568.
  • Pagès-Bernaus, A., Ramalhinho, H., Juan, A. A. and Calvet, L. (2019). Designing e-commerce supply chains: a stochastic facility–location approach. International Transactions in Operational Research, 26, 507–528.
  • Panadero, J., Doering, J., Kizys, R., Juan, A. A. and Fito, A. (2020). A variable neighbourhood search simheuristic for project portfolio selection under uncertainty. Journal of Heuristics, 26, 353–375.
  • Prékopa, A. (2013). Stochastic Programming, Volume 324. Springer Science & Business Media.
  • Qudrat-Ullah, H. and Seong, B. S. (2010). How to do structural validity of a system dynamics type simulation model: the case of an energy policy model. Energy Policy, 38, 2216–2224.
  • Quintero-Araujo, C. L., Caballero-Villalobos, J. P., Juan, A. A. and Montoya-Torres, J. R. (2017). A biasedrandomized metaheuristic for the capacitated location routing problem. International Transactions in Operational Research, 24, 1079–1098.
  • Rabe, M., Deininger, M. and Juan, A. A. (2020). Speeding up computational times in simheuristics combining genetic algorithms with discrete-event simulation. Simulation Modelling Practice and Theory, 103, 102089.
  • Reyes-Rubiano, L., Ferone, D., Juan, A. A. and Faulin, J. (2019). A simheuristic for routing electric vehicles with limited driving ranges and stochastic travel times. SORT-Statistics and Operations Research Transactions, 1, 3–24.
  • Ruszczyński, A. and Shapiro, A. (2003). Stochastic programming models. Handbooks in Operations Research and Management Science, 10, 1–64.
  • Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M. and Tarantola, S. (2008). Global Sensitivity Analysis: the Primer. John Wiley & Sons.
  • Sargent, R. G. (2005). Verification and validation of simulation models. In Proceedings of the Winter simulation Conference, Piscataway, New Jersey, pp. 130–143. IEEE.
  • Shimoyama, K., Oyama, A. and Fujii, K. (2005). A new efficient and useful robust optimization approach design for multi-objective six sigma. In IEEE Congress on Evolutionary Computation, Volume 1, Piscataway, New Jersey, pp. 950–957.
  • Singh, A. and Jana, N. D. (2017). A survey on metaheuristics for solving large scale optimization problems. International Journal of Computer Applications, 170, 1–7.
  • Spall, J. C. (2005). Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control, Volume 65. John Wiley & Sons.
  • Sterman, J. D. (2001). System dynamics modelling: tools for learning in a complex world. California Management Review, 43, 8–25.
  • Taguchi, G. (1989). Introduction to Quality Engineering. American Supplier Institute.
  • Talbi, E.-G. (2009). Metaheuristics: from Design to Implementation. John Wiley & Sons.
  • Taleb, N. N. and Swan, B. (2008). The Impact of the Highly Improbable. Penguin Books Limited.
  • Tigane, S., Kahloul, L. and Bourekkache, S. (2017). Reconfigurable stochastic petri nets: A new formalism for reconfigurable discrete event systems. In International Conference on Mathematics and Information Technology, pp. 301–308. IEEE.
  • Voinov, A. and Bousquet, F. (2010). Modelling with stakeholders. Environmental Modelling & Software, 25, 1268–1281.
  • Wainer, G. A. (2017). Discrete-Event Modeling and Simulation: a Practitioner’s Approach. CRC press.
  • Xu, J., Huang, E., Chen, C.-H. and Lee, L. H. (2015). Simulation optimization: A review and exploration in the new era of cloud computing and big data. Asia-Pacific Journal of Operational Research, 32, 1550019.