EvolveNav: Proactive Preflection and Self-Evolving Memory
for Zero-Shot Object Goal Navigation

*Equal contribution
EvolveNav teaser figure
Method comparison. Left: Our agent learns from (1) past episode history to dynamically update (2) evolved rules. During navigation, it adopts (3) preflection to proactively avoid rule-violating or unpromising rooms, while continuously (4) evolving its rule set from trajectories. Right: Baseline methods rely on passive reaction, leading to inefficient exploration.

Abstract

Zero-Shot Object-Goal Navigation (ZS-OGN) requires embodied agents to explore and locate target objects without any prior training. To this end, recent methods leverage foundation models. But they typically rely on static priors and lack adaptation, which leads to repeated errors and costly trial and error. In this paper, we propose a self-evolving ZS-OGN framework that enables continuous test-time improvement. Specifically, we build an agentic rule memory by extracting actionable knowledge from past trajectories. Then, we propose a retrieval strategy based on upper confidence bound, selecting effective rules by balancing semantic relevance and historical success. In addition, we introduce a memory-guided preflection module that forecasts potential outcomes before action, reducing inefficient exploration. Extensive experiments show that our method outperforms existing training-free baselines, achieving a 10.1% improvement in success rate with fewer unnecessary steps.

Method

EvolveNav transforms training-free navigation into a continuous self-improvement process. The framework couples real-time spatial exploration with a self-evolving cognitive memory through two tightly integrated components.

EvolveNav method overview
Method overview of EvolveNav. Left (Intra-Episode Preflective Exploration): During test-time execution, the agent evaluates frontiers (f1, f2, f3, …, fn) by retrieving top-K rules from the rule bank for LLM-driven preflection. This assesses risks to determine the optimal direction, minimizing trial-and-error. Right (Inter-Episode Rule Self-Evolution): After each episode, the framework distills new rules from the trajectory history. A UCB-based algorithm updates rule weights by balancing credit assignment and exploration potential, continuously refining the rule bank.

Intra-Episode Preflective Exploration

Within an episode, the agent builds a 2D occupancy map and extracts candidate frontiers. Before moving, an LLM retrieves past empirical rules from the rule memory and performs preflection to evaluate the risks of each frontier and select the optimal direction. This shifts navigation from passive correction to proactive risk avoidance.

Inter-Episode Rule Self-Evolution

After each episode, the agent reviews its trajectory and distills key decisions into generalizable rules. A UCB-based algorithm balances exploitation of proven rules with exploration of newly formulated ones, using a momentum-smoothed expected utility μr and confidence bound.

Demo Videos

Qualitative navigation rollouts of EvolveNav across diverse indoor scenes. Each clip shows the agent's first-person view.

Quantitative Results

EvolveNav achieves state-of-the-art training-free performance on both HM3D and MP3D benchmarks, surpassing prior training-free methods by 1.9% (HM3D) and 4.5% (MP3D) in Success Rate.

Comparisons with state-of-the-art methods. The table compares learning-based and training-free methods on HM3D and MP3D across Success Rate (SR) and Success weighted by Path Length (SPL). Higher is better (↑). Gray rows are learning-based; the highlighted row is ours.
Method Venue Training-free Instruction Interpolator HM3D MP3D
Vision Language SR ↑ SPL ↑ SR ↑ SPL ↑
RIMIROS'23 57.827.250.317.0
OVG-NavRAL'24 35.812.3
VLFMICRA'24 BLIP-2 52.530.436.417.5
PIRLNavCVPR'23 64.127.1
XGXICRA'24 72.935.7
ZSONNeurIPS'22 CLIP 25.512.615.34.8
L3MVNIROS'23 RoBERTa-large 50.423.134.914.5
PixNavICRA'24 LLaMA-Adapter GPT-4 37.920.5
VLFMICRA'24 BLIP-2 50.923.632.515.9
SG-NavNeurIPS'24 LLaVA-1.6-7B GPT-4 54.024.940.216.0
OpenFMNavNAACL-F'24 GPT-4V GPT-4 54.924.437.215.7
ActPeptRAL'24 GraphSAGE 39.817.4
InstructNavCoRL'24 GPT-4V GPT-4 58.020.9
ApexNavRAL'25 BLIP-2 DeepSeek-V3 59.633.039.217.8
MFNPICRA'25 Qwen-VLChat-Int4 Qwen2-7B 58.326.741.115.4
MSGNavCVPR'26 GPT-4o GPT-4o 63.031.4
ASCENTRAL'26 BLIP-2 Qwen2.5-7B 65.433.544.515.5
EvolveNav (Ours) BLIP-2 Qwen3-8B 67.333.9 49.019.1
Ablation on core modules. We ablate the Preflection and Memory-Evolving modules on HM3D and MP3D.
# Module HM3D MP3D
PreflectionMemory-Evolve SR ↑SPL ↑ SR ↑SPL ↑
164.732.543.915.8
266.533.547.418.4
366.733.648.318.7
4 67.333.9 49.019.1
Ablation on LLM backbone. Vision model fixed to BLIP-2. EvolveNav is robust across LLM scales.
Instruction Interpolator HM3D MP3D
VisionLanguage SR ↑SPL ↑ SR ↑SPL ↑
BLIP-2 Qwen2.5-7B67.033.948.819.0
Qwen3-8B 67.333.9 49.019.1
Qwen3.5-9B 67.234.1 48.919.2

Qualitative Results

EvolveNav navigation case study
Navigation process visualization of EvolveNav. We show the agent's trajectory alongside its reasoning. During the episode, the agent uses Preflection to evaluate frontiers and proactively avoid unpromising rooms. After the episode, EvolveNav generates a new rule from the history and updates its Rule Bank, autonomously distilling long-term navigation knowledge from short-term trial and error.
Trajectory comparison with ASCENT
Qualitative comparison. Start points, paths, and destinations of EvolveNav and ASCENT on several MP3D scenes. ASCENT's trajectory is notably more convoluted, frequently distracted by adjacent small rooms and narrow corridors. In contrast, EvolveNav produces more direct, globally optimal routes.

BibTeX

@misc{evolvenav2026,
  title         = {EvolveNav: Proactive Preflection and Self-Evolving Memory
                   for Zero-Shot Object Goal Navigation},
  author        = {Chai, Qi and Shen, Wenhao and Yao, Nanjie and Xia, Yue and
                   Zhao, Kaiyong and Ma, Jie and Lin, Guosheng and Wang, Hao},
  year          = {2026},
  eprint        = {2606.18235},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI}
}