Logo image
A structured review of large language models in metaheuristic optimisation
Journal article   Open access   Peer reviewed

A structured review of large language models in metaheuristic optimisation

Reza Ghanbarzadeh and Seyedali Mirjalili
Decision analytics journal, Vol.15, pp.1-23
06/2025
pdf
A structured review of large language models3.03 MBDownloadView
Published (Version of record)CC BY V4.0 Open Access
url
A structured review of large language modelsView
Published (Version of record)CC BY V4.0 Open

Related links

Metrics

3 File views/ downloads
25 Record Views

Abstract

ChatGPT Generative AI Large language models Master of Laws (LLM) Metaheuristic Optimisation algorithms Swarm intelligence Systematic literature review
Metaheuristics are widely used to address complex optimisation problems where traditional exact methods are computationally infeasible or insufficiently flexible. With the rapid advancement of artificial intelligence, large language models, such as ChatGPT, Claude, Gemini, and LLaMA, have emerged as powerful tools capable of enhancing, automating, and adapting various stages of the optimisation process. This systematic literature review investigates the evolving role of large language models in metaheuristic optimisation, with a focus on algorithm generation, parameter tuning, hybridisation, constraint handling, and multi-objective optimisation. Following PRISMA guidelines, 25 studies from nine major scientific databases were selected and analysed. Through thematic analysis, a novel role-based taxonomy was developed that categorises large language model contributions into four functional roles: Advisor, Refiner, Enhancer, and Innovator. The findings demonstrate that large language models support the automation of metaheuristic workflows, enable dynamic adaptation, and contribute to the creation of novel heuristic strategies. Despite these advantages, the review also identifies persistent limitations, including prompt sensitivity, computational overhead, and scalability challenges. These issues highlight the need for more robust evaluation frameworks and benchmarking practices. This review offers a comprehensive synthesis of the current landscape, highlights research gaps, and provides actionable insights for researchers and practitioners aiming to integrate large language models into advanced optimisation systems across domains such as engineering, logistics, and computational design.

Details

Logo image