A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems

Abstract

Recent advances in large language models have sparked growing interest in AI agents capable of solving complex, real-world tasks. However, most existing agent systems rely on manually crafted configurations that remain static after deployment, limiting their ability to adapt to dynamic and evolving environments. Recent research has explored agent evolution techniques that aim to automatically enhance agent systems based on interaction data and environmental feedback. This emerging direction lays the foundation for self-evolving AI agents, which bridge the static capabilities of foundation models with the continuous adaptability required by lifelong agentic systems. In this survey, we provide a comprehensive review of existing techniques for self-evolving agentic systems. Specifically, we first introduce a unified conceptual framework that abstracts the feedback loop underlying the design of self-evolving agentic systems. The framework highlights four key components: System Inputs, Agent System, Environment, and Optimisers, serving as a foundation for understanding and comparing different strategies. Based on this framework, we systematically review a wide range of self-evolving techniques that target different components of the agent system. We also investigate domain-specific evolution strategies developed for specialised fields such as biomedicine, programming, and finance, where optimisation objectives are tightly coupled with domain constraints. In addition, we provide a dedicated discussion on the evaluation, safety, and ethical considerations for self-evolving agentic systems, which are critical to ensuring their effectiveness and reliability. This survey aims to provide researchers and practitioners with a systematic understanding of self-evolving AI agents, laying the foundation for the development of more adaptive, autonomous, and lifelong agentic systems.

1. Introduction

Progress in large-scale pretraining, supervised fine-tuning, and reinforcement learning has given large language models remarkable capabilities in planning, reasoning, and language understanding, sparking interest in LLM-based agents — autonomous systems that use an LLM as the decision and policy module to understand inputs, plan actions, and generate outputs in open-ended, real-world environments. A typical agent centres on a foundation model that interprets goals, plans, and executes, supported by perception, planning, memory, and tool modules. Such systems have been successfully applied to code generation, scientific research, web navigation, and specialised applications in biomedicine and finance.

Despite this progress, most systems — single- or multi-agent — remain static after deployment: handcrafted workflows, fixed communication protocols, and human-curated toolchains that cannot keep pace with open-ended environments where requirements, resources, and goals continuously change. The Multi-Agent Self-Evolving (MASE) paradigm addresses this by closing the loop between deployment and continual improvement: a population of agents autonomously refines its prompts, memory, tool-use strategies, and even interaction topology, guided by environment feedback and meta-rewards, evolving over its operational lifetime rather than adapting once.

This vision is guided by the Three Laws of Self-Evolving AI Agents — Endure (safety adaptation), Excel (performance preservation), and Evolve (autonomous optimisation): monitor performance and safety during operation, preserve or enhance capabilities through controlled incremental updates, and autonomously adapt components in response to shifting tasks and environments. The survey's contributions are a unified conceptual framework abstracting the evolution loop, a systematic review of single-agent, multi-agent, and domain-specific self-evolution techniques, a dedicated discussion of evaluation, safety, and ethics, and a roadmap of the MOP-to-MOA-to-MAO-to-MASE shift, supported by the open-source EvoAgentX framework and the Awesome-Self-Evolving-Agents repository.

2. Foundation of AI Agent Systems

An AI agent is an autonomous system that perceives inputs, reasons about goals, and interacts with the environment to complete tasks. At its core sits a foundation model — most commonly an LLM, with the principles generalising to vision–language and other backbones — acting as the central reasoning engine, surrounded by supporting modules: perception, which builds reasoning-ready representations from text, audio, and video; planning, which decomposes complex tasks, from simple linear decomposition such as chain-of-thought prompting to dynamic approaches interleaving planning and execution such as ReAct, to branching strategies such as Tree-of-Thought and Graph-of-Thought that explore multiple reasoning paths; short-term memory for ongoing context and long-term memory for accumulated experience; and tool-use policies for interacting with the external world.

Multi-agent systems (MAS) arose to address single-agent shortcomings in task specialisation and coordination within complex environments: each agent specialises in a subtask or domain of expertise, and agents exchange information and coordinate behaviour to achieve shared goals, accomplishing what no single agent could while simulating more realistic, dynamic settings. Yet even the most advanced frameworks still depend on handcrafted workflows and fixed protocols, constraining the ability to sustain performance in long-lived, open-ended environments.

The survey traces an evolutionary trajectory from Model Offline Pretraining (MOP) through Model Online Adaptation (MOA) and Multi-Agent Orchestration (MAO) to Multi-Agent Self-Evolving (MASE) systems that embed a continuous improvement loop at the core of the architecture. Rather than requiring human designers to handcraft every interaction pattern, a lifelong self-evolving system generates, evaluates, and refines its own agentic configurations — transforming from a static executor into a continually learning, co-evolving participant — with far-reaching implications for scientific discovery, software engineering, and human–AI collaboration, extending into the physical world through robotics, IoT devices, and cyber–physical infrastructures, on a path toward scalable, sustainable, trustworthy AI that lives, learns, and lasts.

3. A Conceptual Framework of MASE

The survey proposes a high-level conceptual framework abstracting the key elements behind the design of agent evolution and optimisation methods, enabling a comprehensive understanding of the field and comparative analysis across approaches. The self-evolving process begins with a task specification — a high-level description, input data, context, or examples — constituting the system inputs; the agent system (single- or multi-agent) is then deployed to perform the task within an environment that generates feedback signals derived from predefined evaluation metrics; the optimiser applies specific algorithms and strategies to update the system — adjusting LLM parameters, modifying prompts, or refining structure — and may synthesise training examples to expand available data, before the updated system is redeployed to begin a new cycle. This closed feedback loop repeats until a performance threshold or convergence criterion is met, and EvoAgentX is the first open-source framework to automate the generation, execution, evaluation, and optimisation of agentic systems under this process.

System inputs take two forms: task-level optimisation, the most common setting, where the system is improved on a specific task given a task description and training set, with dynamically synthesised surrogate data via LLM-based generation when labelled data is unavailable; and instance-level optimisation, a finer-grained setting targeting performance on a specific example given an input–output pair with optional context. The agent system is the core of the loop subject to optimisation, decomposable into the underlying LLM, prompting strategy, memory module, tool-use policy, and — for multiple agents — interaction topology.

The environment provides the operating context and feedback via proxy metrics — accuracy, F1, success rate — or via LLM-based evaluators in specialised domains such as coding, law, medicine, and research. The optimiser is defined by a search space (prompt templates, tool selection, LLM parameters, architectures) and an optimisation algorithm ranging from rule-based heuristics and gradient descent to Bayesian, Monte Carlo tree search, reinforcement learning, and learning-based policies — a map onto which every work in the literature can be placed: what is optimised, how, and with which feedback signal.

4. Single-Agent Optimisation

Self-evolution starts with the single agent via optimisation of the LLM's behaviour along two paths: training-based optimisation, which updates weights with interaction data — supervised fine-tuning and reinforcement learning over reasoning trajectories and environment observations — instilling new capabilities at significant computational cost; and test-time optimisation, which refines reasoning without weight updates, such as regenerating and selecting trajectories, self-verification, and self-critique, adapting per instance more cheaply but bounded by the frozen model's capability ceiling.

Prompt optimisation forms a broad family with no weight updates: direct editing driven by rules and feedback; generative approaches where an LLM rewrites and proposes prompt alternatives; text-gradient-based methods where linguistic critiques act as "gradients" guiding iterative refinement; and evolutionary approaches maintaining a population of candidate prompts under mutation, crossover, and selection. These methods differ in search cost, interpretability, and dependence on evaluation signals, but all treat the prompt as the primary and cheapest optimisation variable.

Optimisation extends to memory and tools: short-term memory is improved through context management, summarisation, and retrieval of relevant spans, while long-term memory is improved by consolidating, indexing, and recalling experiences over time to preserve long-range consistency; tool use is optimised by training correct invocation, by adaptive per-step tool selection at inference time, and — at maturity — by optimising tool functionality itself: discovering, composing, and adapting new tools, so that agent and toolset co-evolve rather than the toolset remaining a designer-imposed fixture.

5. Multi-Agent Optimisation

Manually designed multi-agent systems use handcrafted workflows with fixed role assignments: specialised agents for subtasks, pre-specified communication protocols, and rigid interaction topologies. This design performs strongly on known tasks but is brittle under novel tasks and changing environments: any requirements shift demands human redesign, with cost and fragility growing as the system scales.

Self-evolving multi-agent systems overcome this rigidity by optimising every layer of collective organisation: multi-agent prompt optimisation coordinating each agent's instructions with its roles; topology optimisation reshaping who talks to whom and when — pruning redundant links and adding new coordination paths; unified optimisation treating prompts and topology jointly as one decision; and LLM backbone optimisation selecting or tuning the most suitable model per role, recognising that differing reasoning capabilities demand different model sizes and skills.

The comparison reveals fundamental trade-offs: optimising large-scale multi-agent systems improves performance but incurs heavy computational cost, latency, and instability, leaving the explicit effectiveness–efficiency trade-off unresolved; and optimised prompts and topologies are often brittle, generalising poorly across LLM backbones with differing reasoning abilities, which undermines scalability and reuse in production and calls for resource-aware, transferable optimisation methods.

6. Domain-Specific Optimisation

In biomedicine, evolution strategies are governed by strict domain constraints: medical diagnosis agents learn from clinical records and guidelines amid scarce reliable ground truth and high error sensitivity, while molecular discovery and symbolic reasoning agents navigate vast chemical spaces requiring integrated specialist knowledge, bespoke evaluation criteria, and regulatory compliance — feedback signals here blending computational metrics, laboratory validation, and expert judgement.

Programming is the ideal domain for self-evolution because feedback is executable: code refinement agents iteratively improve output quality guided by test results and compilers, and debugging agents diagnose faults, propose fixes, and verify them executably in a closed loop — executability providing an objective reward signal rare in other domains, though generalisation to unseen codebases and projects remains an open challenge.

In finance and legal research, optimisation objectives intertwine with regulatory constraints: financial decision-making agents balance return and risk under compliance rules and market volatility, while legal reasoning agents handle open-textured norms difficult to encode as reward functions — both domains showing that successful agent evolution is not purely technical optimisation but domain-aware adaptation integrating heterogeneous knowledge sources, bespoke evaluation criteria, and legal compliance into the heart of the optimisation loop.

7. Evaluation

Agent evaluation splits into benchmark-based and model-based strands: the former covers tool- and API-driven agents, web navigation and browsing agents, multi-agent collaboration and generalists, GUI and multimodal environment agents, and domain-specific task agents — benchmarks measuring functional success but as static snapshots that saturate quickly and struggle to reflect real-world complexity and extended interaction.

Model-based evaluation offers a scalable alternative: LLM-as-a-Judge scoring outputs against stated criteria, and Agent-as-a-Judge — as in the methodology applied to the DevAI benchmark for code-generation agents — where specialised modules analyse intermediate artefacts, construct reasoning graphs, and validate hierarchical requirements, yielding judgements aligned more closely with human experts than traditional approaches, at lower time and cost, albeit with added complexity and generalisation challenges beyond code generation.

Safety, alignment, and robustness form the primary constraint on all evolution under the law of Endure: safety is not a one-off certification but an ongoing requirement — every evolution step, from prompt updates to topology changes, must be behaviourally screened. Risk-focused benchmarks such as AgentHarm measure an agent's propensity to comply with explicitly malicious multi-step requests such as fraud or cybercrime; specialist probes such as RedCode for code security and MobileSafetyBench for mobile control stress-test agents in realistic sandboxed environments; MACHIAVELLI explores the emergence of unethical power-seeking strategies under reward pressure; and SafeLawBench shows state-of-the-art models still failing established legal principles — yet most evaluations remain snapshot-based, while self-evolution demands longitudinal, evolution-aware benchmarks tracking safety across the full lifecycle of the agent ecosystem, an open and urgent challenge.

8. Challenges and Future Directions

The open obstacles group naturally under the Three Laws: under Endure, most optimisation pipelines prioritise task metrics over safety constraints, neglecting unintended behaviours, privacy breaches, and misaligned objectives, while existing legal frameworks such as the EU AI Act and GDPR assume static models and fixed decision logic and cannot track evolving agents — calling for evolution-aware audit mechanisms, licences, and legal protocols that track and constrain an agent's self-directed evolutionary path; learned reward models for intermediate reasoning steps additionally suffer dataset scarcity, noisy supervision, and feedback inconsistency, producing unstable or divergent behaviours.

Under Excel, trustworthy feedback signals are hard to build where ground truth is absent or disputed, as in medicine or law; large-scale multi-agent optimisation improves performance at steep computational, latency, and stability cost with no satisfactory effectiveness–efficiency resolution; and optimised prompts and topologies remain brittle across backbones, undermining scalability. Under Evolve, most optimisation algorithms are text-only while real-world agents must process multimodal inputs and reason in spatially continuous environments — demanding internal world models and perceptual–temporal reasoning — and current methods assume a fixed toolset, overlooking autonomous tool discovery, adaptation, and co-evolution with agents.

These limitations point to promising avenues along the MOP-to-MASE trajectory: open-ended interactive simulation platforms where agents iteratively interact and refine their components via closed-loop optimisation; moving beyond static tool invocation toward adaptive tool selection, composition, and creation with reinforcement learning; benchmarks and protocols reflecting real-world complexity with interactive, longitudinal assessment; optimisation algorithms jointly modelling performance and resource constraints for deployment under strict latency, cost, or energy budgets; and domain-aware evolution for scientific and specialised applications integrating knowledge and regulatory compliance — addressing these challenges with high-performing, domain-adaptive, safe, regulation-aware, self-sustaining pipelines, grounded in the Three Laws, charts a coherent roadmap toward truly lifelong, autonomous agentic systems that endure, excel, and evolve across their full operational lifetimes.

9. Conclusions

The survey concludes that the future of agents lies beyond the static capabilities of foundation models, in lifelong self-evolving systems: it presented a unified conceptual framework abstracting the feedback loop into four components — system inputs, agent system, environment, and optimisers — and systematically reviewed self-evolution techniques for the single agent (model behaviour, prompts, memory, tools), the multi-agent collective (prompts, topology, unified optimisation, backbones), and specialised domains, alongside an in-depth discussion of evaluation, safety, and ethics.

Three core messages stand out: what to optimise — every component of the agentic system is a legitimate evolution target, from the cheapest prompt to the organisational structure; how — a search space and optimisation algorithm chosen in light of the available feedback signal and optimisation cost; and how to trust — continuous, granular, scalable evaluation making Endure a first-order constraint rather than a post-hoc certificate, with longitudinal benchmarks tracking safety across the complete lifecycle.

The survey calls on researchers and practitioners to build on this systematic understanding toward more adaptive, autonomous, and lifelong agentic systems — systems not trained once but that live, learn, and last — stressing that the path runs through safe, domain-aware, self-sustaining optimisation pipelines grounded in the Three Laws: Endure, Excel, and Evolve.