Industry observers note that looping is a powerful inductive bias for reasoning. By repeatedly iterating a recurrent block, looped models can scale their effective depth and enable multi-step reasoning in latent space. However, existing looped models are not inherently guided by an explicit measure of progress, making it difficult to determine when to stop looping and how to improve upon the current state. To enable this, we introduce Energy-Based Reasoners (EBRs), which learn an energy function over latent reasoning states and formulate looped updates as gradient descent on this energy. The energy scores latent states, while its gradient guides refinement and provides a signal for stopping. To train EBRs effectively, we further introduce exploration-based training to discover additional modes and to better shape the energy landscape over a broader set of states. Across four algorithmic reasoning benchmarks, EBRs match or outperform prior recurrent reasoning models, achieving 99.9% accuracy on Sudoku-Extreme while using 345× less inference compute than the next-best model and maintaining comparable training compute. On all multi-solution benchmarks, EBRs achieve state-of-the-art coverage of distinct valid solutions while maintaining near-100% single-sample accuracy. These results suggest that energy-based models are a promising approach for strong reasoning performance.

Existing looped reasoners upgrade their latent state without any explicit assessment of it. An EBR learns an energy function that guides refinement, stopping and selection.

Sources indicate that score. The energy rates the compatibility between the reasoning state z and the initial board x. Lower means better compatibility.

Refine. The gradient turns the score into an improvement direction.

Sources indicate that stop. The state becomes stationary once the gradient is small, so the gradient acts as a stopping criterion.

Recent findings suggest that select. Among multiple candidate solutions, we pick the one with the lowest energy.

According to recent reports, correct solutions settle at low-energy stationary states. Energy, gradient norm and step size during descent on Sudoku-Extreme. Correct trajectories settle at low energy with small gradients, while wrong ones keep moving.

Running more descent steps refines each answer further, and running more trajectories gives the energy more candidates to choose the lowest-energy one from.

EBRs reach EqR's best accuracy with 7× fewer iterations (left) and 43× fewer samples (right).

GRAM and TRM from GRAM's paper; EqR from its released checkpoint. Mean ± SD over three seeds.

Each trajectory stops once its energy gradient falls below a threshold, so easy puzzles finish in a few steps and hard ones keep going.

According to recent reports, EBRs give the best single-sample accuracy among reasoning models. Within only 5 passes, they reach 99.9% and 88.3%, ahead of methods that draw up to 128. Stopping each trajectory once its energy gradient falls below a threshold keeps 99.9% accuracy with 10.9× fewer FLOPs than a fixed-depth EBR, allowing us to surpass EqR with 345× fewer FLOPs.

EBR acts like stochastic gradient descent and can capture many different solutions. Coverage captures the share of each input's distinct valid solutions that 20 samples find.

Recent findings suggest that pass@1 (%) and Conflicts (edges summed over the test graphs) use one sample. Cov@20 is the share of distinct valid solutions found by 20 samples (%). Baselines from GRAM's paper.

→ Read original article