Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction

inject-a-turn,-not-a-token:-learning-where-to-redirect-llm-reasoning-for-self-correction

Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction

[Submitted on 9 Oct 2026 (v1), last revised 13 Nov 2026 (this version, v2)]

View PDF HTML (experimental)

Abstract:Large language models struggle to reliably identify and correct errors in their own reasoning. Unlike prior training-based approaches that fine-tune an LLM to generate revisions or feedback, we learn where to intervene in failed rollouts and determine how to redirect them. To choose where to intervene, we train a 130K-parameter MLP head on a frozen encoder using only final-answer correctness. For redirection, we find that under a fixed generation budget, the tested inline injections fail to reliably redirect reasoning, whereas presenting the same instruction in a new user turn changes the model’s course. The resulting correction framework, UPTURN (User-Prompt TURN injection at a learned position), requires no LLM fine-tuning: it retains a selected prefix, injects an instruction as a new user turn, and regenerates the suffix. Across four reasoners and six math benchmarks, UPTURN improves average accuracy in every setting over a 32-rollout baseline. It outperforms self-correction and reflection-token injection baselines under matched correction budgets, transfers across reasoners and to GPQA-Diamond without retraining, and complements GRPO and self-correction methods.

Submission history

From: Jiwon Jeon [view email]
[v1] Fri, 9 Oct 2026 14:37:51 UTC (1,694 KB)
[v2] Fri, 13 Nov 2026 06:05:58 UTC (1,816 KB)