Interdisciplinary Research on LLM and Evolutionary Computation

A list of awesome papers and resources of the intersection of Large Language Models and Evolutionary Computation.

🎉 News: Our survey has been released. Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap

The related work and projects will be updated soon and continuously.

If our work has been of assistance to you, please feel free to cite our survey. Thank you.

@article{wu2024evolutionary,
  title={Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap},
  author={Wu, Xingyu and Wu, Sheng-hao and Wu, Jibin and Feng, Liang and Tan, Kay Chen},
  journal={CoRR},
  volume={abs/2401.10034},
  year={2024}
}

Table of Contents

• Interdisciplinary Research on LLM and Evolutionary Computation
• Table of Contents
  • LLM-enhanced EA
    • LLM-assisted Black-box Optimization
    • LLM-assisted Optimization Algorithm Generation
    • LLM Empower EA for Other Capabilities
  • EA-enhanced LLM
    • EA-based Prompt Engineering
    • EA-based LLM Architecture Search
    • EA Empower LLM for Other Capabilities
  • Applications Driven by Integrated Synergy of LLM and EA
    • Code Generation
    • Software Engineering
    • Neural Architecture Search
    • Others Generative Tasks

LLM-enhanced EA

LLM-assisted Black-box Optimization

Category	Name	Paper	Venue	Year	Code
Evaluation	N/A	Exploring the True Potential: Evaluating the Black-Box Optimization Capability of Large Language Models	arXiv	2024	N/A
Evaluation	N/A	Towards Optimizing with Large Language Models	arXiv	2023	N/A
Single-objective	OPRO	Large Language Models as Optimizers	ICLR	2024	Python
Single-objective	LMX	Language Model Crossover: Variation through Few-Shot Prompting	arXiv	2023	N/A
Single-objective	LMEA	Large Language Models as Evolutionary Optimizers	CEC	2024	N/A
Single-objective	EvoLLM	Large Language Models As Evolution Strategies	arXiv	2024	N/A
Single-objective	Huang et al.	How Multimodal Integration Boost the Performance of LLM for Optimization: Case Study on Capacitated Vehicle Routing Problems	arXiv	2024	N/A
Single-objective	LEO	Large Language Model-Based Evolutionary Optimizer: Reasoning with Elitism	arXiv	2024	N/A
Single-objective (Application)	Zhang et al.	CUDA-Accelerated Soft Robot Neural Evolution with Large Language Model Supervision	arXiv	2024	N/A
Single-objective (Application)	LLM-Mutate	Evolving Interpretable Visual Classifiers with Large Language Models	arXiv	2024	N/A
Multi-objective	QDAIF	Quality-Diversity through AI Feedback	Workshop at NeurIPS	2023	Python
Multi-objective	LLM4MOEA	Large Language Model for Multi-objective Evolutionary Optimization	arXiv	2023	Python
Multi-objective	In-context QD	Large Language Models as In-context AI Generators for Quality-Diversity	arXiv	2024	N/A
Multi-objective	CMOEA-LLM	Large Language Model-Aided Evolutionary Search for Constrained Multiobjective Optimization	arXiv	2024	N/A

LLM-assisted Optimization Algorithm Generation

Name	Paper	Venue	Year	Code	Generated Algorithm
Pluhacek et al.	Leveraging Large Language Models for the Generation of Novel Metaheuristic Optimization Algorithms	GECCO	2023	N/A	Hybrid swarm intelligence optimization algorithm
OptiMUS	OptiMUS: Optimization Modeling Using MIP Solvers and Large Language Models	arXiv	2023	Python	Mixed-integer linear programming problem
ZSO	Leveraging Large Language Model to Generate a Novel Metaheuristic Algorithm with CRISPE Framework	arXiv	2024	Python	Zoological search optimization algorithm
AEL	Evolution of Heuristics: Towards Efficient Automatic Algorithm Design using Large Language Model	ICML	2024	Python	Heuristic algorithm
ReEvo	ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution	arXiv	2024	Python	Heuristic algorithm
LLM_GP	Evolving Code with A Large Language Model	arXiv	2024	N/A	Genetic Programming
SR-EAD	Evolution Transformer: In-Context Evolutionary Optimization	arXiv	2024	Python	Evolutionary strategy or evolution transformer
EvolCAF	Evolve Cost-aware Acquisition Functions Using Large Language Models	arXiv	2024	Python	Cost-aware Bayesian optimization
Kramer	Large Language Models for Tuning Evolution Strategies	arXiv	2024	N/A	Evolution Strategies

LLM Empower EA for Other Capabilities

Name	Paper	Venue	Year	Code	Enhancement Aspect
OptiChat	Diagnosing Infeasible Optimization Problems Using Large Language Models	arXiv	2023	Python	Identify potential sources of infeasibility
AS-LLM	Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representation	IJCAI	2024	Python	Algorithm representation and algorithm selection
GP4NLDR	Explaining Genetic Programming Trees Using Large Language Models	arXiv	2024	N/A	Provide explainability for results of EA
Singh et al.	Enhancing Decision-Making in Optimization through LLM-Assisted Inference: A Neural Networks Perspective	IJCNN	2024	N/A	Provide explainability for results of EA

EA-enhanced LLM

EA-based Prompt Engineering

Category	Name	Paper	Venue	Year	Code
Discrete Prompt Optimization	GPS	GPS: Genetic Prompt Search for Efficient Few-shot Learning	EMNLP	2022	Python
Discrete Prompt Optimization	GrIPS	GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models	EACL	2023	Python
Discrete Prompt Optimization	EvoPrompt	Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers	ICLR	2024	Python
Discrete Prompt Optimization	Plum	Plum: Prompt Learning Using Metaheuristic	arXiv	2023	Python
Discrete Prompt Optimization	PromptBreeder	Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution	arXiv	2023	N/A
Discrete Prompt Optimization	SPELL	SPELL: Semantic Prompt Evolution Based on A LLM	arXiv	2023	N/A
Discrete Prompt Optimization	EoT prompting	Zero-Shot Chain-of-Thought Reasoning Guided by Evolutionary Algorithms in Large Language Models	arXiv	2024	Python
Discrete Prompt Optimization	iPrompt	Explaining Patterns in Data with Language Models via Interpretable Autoprompting	arXiv	2023	Python
Discrete Prompt Optimization	PhaseEvo	PhaseEvo: Towards Unified In-Context Prompt Optimization for Large Language Models	arXiv	2024	N/A
Discrete Prompt Optimization	InstOptima	InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operators	EMNLP	2023	Python
Discrete Prompt Optimization	EMO-Prompts	Evolutionary Multi-Objective Optimization of Large Language Model Prompts for Balancing Sentiments	EvoApplications	2024	Python
Gradient-Free Soft Prompt Optimization	BBT	Black-Box Tuning for Language-Model-as-a-Service	ICML	2022	Python
Gradient-Free Soft Prompt Optimization	BBTv2	BBTv2: Towards a Gradient-Free Future with Large Language Models	EMNLP	2022	Python
Gradient-Free Soft Prompt Optimization	Clip-Tuning	Clip-Tuning: Towards Derivative-free Prompt Learning with a Mixture of Rewards	EMNLP	2022	N/A
Gradient-Free Soft Prompt Optimization	Shen et al.	Reliable Gradient-free and Likelihood-free Prompt Tuning	ACL	2023	Python
Gradient-Free Soft Prompt Optimization	BPT-VLM	Black-box Prompt Tuning for Vision-Language Model as a Service	IJCAI	2023	Python
Gradient-Free Soft Prompt Optimization	Fei et al.	Gradient-Free Textual Inversion	MM	2023	Python
Prompt Generation for Data Augmentation	Evol-Instruct	WizardLM: Empowering Large Language Models to Follow Complex Instructions	ICLR	2024	Python
Prompt Generation for Data Augmentation	Sun et al.	Dial-insight: Fine-tuning Large Language Models with High-Quality Domain-Specific Data Preventing Capability Collapse	arXiv	2024	N/A
Prompt Generation for Security	AutoDAN	AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models	ICLR	2024	Python
Prompt Generation for Security	Jailbreak Attacks	Open Sesame! Universal Black Box Jailbreaking of Large Language Models	arXiv	2024	N/A
Prompt Generation for Security	SMEA	Is the System Message Really Important to Jailbreaks in Large Language Models?	arXiv	2024	N/A
Prompt Generation for Security	Shi et al.	Red Teaming Language Model Detectors with Language Models	TACL	2024	Python

EA-based LLM Architecture Search

Note: Approaches discussed here primarily focus on LLM architecture search, and their techniques are based on EAs.

Name	Paper	Venue	Year	Code	LLM
AutoBERT-Zero	AutoBERT-Zero: Evolving BERT Backbone from Scratch	AAAI	2022	Python	BERT
SuperShaper	SuperShaper: Task-Agnostic Super Pre-training of BERT Models with Variable Hidden Dimensions	arXiv	2021	N/A	BERT
AutoTinyBERT	AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models	ACL	2021	Python	BERT
LiteTransformerSearch	LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Models	NeurIPS	2022	Python	GPT-2
Klein et al.	Structural Pruning of Large Language Models via Neural Architecture Search	AutoML	2023	N/A	BERT
Choong et al.	Jack and Masters of All Trades: One-Pass Learning of a Set of Model Sets from Foundation AI Models	IEEE CIM	2023	N/A	M2M100-418M, ResNet-18

EA Empower LLM for Other Capabilities

Name	Paper	Venue	Year	Code	Enhancement Aspect
Length-Adaptive Transformer Model	Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search	ACL	2021	Python	Automatically adjust the sequence length according to different computational resource constraints
HexGen	HexGen: Generative Inference of Large-Scale Foundation Model over Heterogeneous Decentralized Environment	arXiv	2023	Python	Deploy generative inference services for LLMs in a heterogeneous distributed environment
LongRoPE	LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens	arXiv	2023	Python	Extend the context window of LLMs to 2048k tokens
Evolutionary Model Merge	Evolutionary Optimization of Model Merging Recipes	arXiv	2024	Python	Utilize CMA-ES algorithm to optimize merged LLM in both parameter and data flow space
BLADE	BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models	arXiv	2024	N/A	Find soft prompts that optimizes the consistency between the outputs of two models
Self-evolution in LLM	A Survey on Self-Evolution of Large Language Models	arXiv	2024	Summary	Some studies for LLM self-evolution also adopted the ideas of EAs

Applications Driven by Integrated Synergy of LLM and EA

Code Generation

Name	Paper	Venue	Year	Code	Applicable scenarios
ELM	Evolution through Large Models	arXiv	2022	Python	Universal code generation
OpenELM	The OpenELM Library: Leveraging Progress in Language Models for Novel Evolutionary Algorithms	arXiv	2024	Python	Open-source Python library
Pinna et al.	Enhancing Large Language Models-Based Code Generation by Leveraging Genetic Improvement	ECGP	2024	Python	Universal code generation
WizardCoder	WizardCoder: Empowering Code Large Language Models with Evol-Instruct	ICLR	2024	Python	Universal code generation
SEED	SEED: Domain-Specific Data Curation With Large Language Models	arXiv	2023	N/A	Data cleaning tasks
EUREKA	Eureka: Human-Level Reward Design via Coding Large Language Models	ICLR	2024	Python	Design reward in reinforcement learning
EROM	Evolutionary Reward Design and Optimization with Multimodal Large Language Models	Workshop at ICRA	2023	N/A	Design reward in reinforcement learning
Zhang et al.	A Simple Framework for Intrinsic Reward-Shaping for RL using LLM Feedback	Github	2024	N/A	Design reward in reinforcement learning
Diffusion-ES	Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following	arXiv	2024	N/A	Design reward in reinforcement learning
GPT4AIGChip	GPT4AIGChip: Towards Next-Generation AI Accelerator Design Automation via Large Language Models	ICCAD	2023	N/A	Design AI accelerator
FunSearch	Mathematical discoveries from program search with large language models	Nature	2023	Python	For mathematical and algorithmic discovery
L-AutoDA	L-AutoDA: Leveraging Large Language Models for Automated Decision-based Adversarial Attacks	arXiv	2024	N/A	For decision-based adversarial attacks
LLM-SR	LLM-SR: Scientific Equation Discovery via Programming with Large Language Models	arXiv	2024	Python	For scientific equation discovery from data
Shojaee et al.	Identify Critical Nodes in Complex Network with Large Language Models	arXiv	2024	Python	Node importance scoring functions in complex networks
DeceptPrompt	DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions	arXiv	2023	N/A	For LLM Security
G3P with LLM	Program Synthesis with Generative Pre-trained Transformers and Grammar-Guided Genetic Programming Grammar	LA-CCI	2023	N/A	For LLM Security

Software Engineering

Name	Paper	Venue	Year	Code	Applicable scenarios
Kang et al.	Towards Objective-Tailored Genetic Improvement Through Large Language Models	Workshop at ICSE	2023	N/A	Software Optimization
Brownlee et al.	Enhancing Genetic Improvement Mutations Using Large Language Models	SSBSE	2023	N/A	Software Optimization
TitanFuzz	Large Language Models Are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models	ISSTA	2023	N/A	Software Testing
CodaMOSA	CODAMOSA: Escaping Coverage Plateaus in Test Generation with Pre-trained Large Language Models	ICSE	2023	Python	Software Testing
SBSE	Search-based Optimisation of LLM Learning Shots for Story Point Estimation	SSBSE	2023	N/A	Software Project Planning

Neural Architecture Search

Note: Methods reviewed here leverage the synergistic combination of EAs and LLMs, which are more versatile and not limited to LLM architecture search alone, applicable to a broader range of NAS tasks..

Name	Paper	Venue	Year	Code	Role of LLM
GPT-NAS	GPT-NAS: Evolutionary Neural Architecture Search with the Generative Pre-Trained Model	arXiv	2023	N/A	Representation Capability
LLMatic	LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimization	GECCO	2024	Python	Generation Capability
Evoprompting	EvoPrompting: Language Models for Code-Level Neural Architecture Search	NeurIPS	2023	Python	Generation Capability
Guided Evolution	LLM Guided Evolution -- The Automation of Models Advancing Models	arXiv	2023	Python	Generation Capability
GPTN-SS	Discovering More Effective Tensor Network Structure Search Algorithms via Large Language Models (LLMs)	arXiv	2024	N/A	Generation Capability
GENIUS	Can GPT-4 Perform Neural Architecture Search?	arXiv	2023	Python	Generation Capability
GPT4GNAS	Graph Neural Architecture Search with GPT-4	arXiv	2023	N/A	Generation Capability
Jawahar et al.	LLM Performance Predictors are good initializers for Architecture Searc	arXiv	2023	N/A	Reasoning Capability
ReStruct	Large Language Model-driven Meta-structure Discovery in Heterogeneous Information Network	arXiv	2024	N/A	Reasoning Capability

Others Generative Tasks

Task	Name	Paper	Venue	Year	Code
Text Generation	NSG	Enhancing LLM with Evolutionary Fine Tuning for News Summary Generation	Journal of Intelligent and Fuzzy Systems	2024	N/A
Text Generation	SCAPE	SCAPE: Searching Conceptual Architecture Prompts using Evolution	CEC	2024	Python
Text Generation	Mario-GPT	Prompt-Guided Level Generation	GECCO	2024	Python
Text-to-image Generation	StableYolo	StableYolo: Optimizing Image Generation for Large Language Models	SSBSE	2023	Python
Natural Science	Researchers from McGill University	14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon	Digital Discovery	2023	N/A
Natural Science	LLM-GA	Integrating Genetic Algorithms and Language Models for Enhanced Enzyme Design	ChemRxiv	2024	N/A
Social Science	Suzuki et al.	An Evolutionary Model of Personality Traits Related to Cooperative Behavior Using A Large Language Model	Scientific Reports	2024	N/A
LLM as Agent	FoA	Fleet of Agents: Coordinated Problem Solving with Large Language Models using Genetic Particle Filtering	ArXiv	2024	N/A

Hope our conclusion can help your work.