llamda: LLm AutoMatically Designed Algorithms
This project builds upon the following works:
| Project | Paper | Repository | Citation |
|---|---|---|---|
| FunSearch | Mathematical Discoveries from Program Search with Large Language Models | google-deepmind/funsearch | Romera-Paredes et al., Nature, 2024 |
| EoH | Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model | FeiLiu36/EoH | Liu et al., ICML, 2024 |
| ReEvo | ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution | ai4co/reevo | Ye et al., NeurIPS, 2024 |
| HSEvo | HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMs | datphamvn/HSEvo | Dat et al., AAAI, 2025 |
| MCTS-AHD | Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Design | zz1358m/MCTS-AHD-master | Zheng et al., ICML, 2025 |
| DeepACO | DeepACO: neural-enhanced ant systems for combinatorial optimization | henry-yeh/DeepACO | Ye et al., NeurIPS, 2023 |
Note: Code files adapted from external sources include attribution in header comments. Prompt files are attributed in llamda/prompts/README.md.
Click to expand BibTeX entries
@article{romera-paredes2024,
title = {Mathematical Discoveries from Program Search with Large Language Models},
author = {Romera-Paredes, Bernardino and Barekatain, Mohammadamin and Novikov, Alexander and Balog, Matej and Kumar, M. Pawan and Dupont, Emilien and Ruiz, Francisco J. R. and Ellenberg, Jordan S. and Wang, Pengming and Fawzi, Omar and Kohli, Pushmeet and Fawzi, Alhussein},
journaltitle = {Nature},
year = {2024},
volume = {625},
number = {7995},
pages = {468--475},
doi = {10.1038/s41586-023-06924-6}
}
@inproceedings{fei2024eoh,
title={Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model},
author={Fei Liu, Xialiang Tong, Mingxuan Yuan, Xi Lin, Fu Luo, Zhenkun Wang, Zhichao Lu, Qingfu Zhang},
booktitle={International Conference on Machine Learning (ICML)},
year={2024},
url={https://arxiv.org/abs/2401.02051}
}
@inproceedings{zheng2025monte,
title={Monte Carlo Tree Search for Comprehensive Exploration in {LLM}-Based Automatic Heuristic Design},
author={Zhi Zheng and Zhuoliang Xie and Zhenkun Wang and Bryan Hooi},
booktitle={Forty-second International Conference on Machine Learning},
year={2025},
url={https://openreview.net/forum?id=Do1OdZzYHr}
}
@inproceedings{ye2024reevo,
title={ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution},
author={Ye, Haoran and Wang, Jiarui and Cao, Zhiguang and Berto, Federico and Hua, Chuanbo and Kim, Haeyeon and Park, Jinkyoo and Song, Guojie}, booktitle={Advances in Neural Information Processing Systems},
year={2024},
note={\url{https://github.com/ai4co/reevo}}
}
@inproceedings{dat2025hsevo,
title={Hsevo: Elevating automatic heuristic design with diversity-driven harmony search and genetic algorithm using llms},
author={Dat, Pham Vu Tuan and Doan, Long and Binh, Huynh Thi Thanh},
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
volume={39},
number={25},
pages={26931--26938},
year={2025},
note={\url{https://github.com/datphamvn/HSEvo}}
}
@inproceedings{ye2023deepaco,
title={DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimization},
author={Ye, Haoran and Wang, Jiarui and Cao, Zhiguang and Liang, Helan and Li, Yong},
booktitle={Advances in Neural Information Processing Systems},
year={2023}
}This project is licensed under the MIT License - see the LICENSE file for details.