Distilling insights with ReasoningBank
ReasoningBank distills international reasoning patterns into high-level, structured reminiscences. Every structured reminiscence merchandise accommodates the next:
- Title: A concise identifier summarizing the core technique.
- Description: A quick abstract of the reminiscence merchandise.
- Content material: The distilled reasoning steps, resolution rationales, or operational insights extracted from previous experiences.
The reminiscence workflow operates in a steady, closed loop of retrieval, extraction, and consolidation. Earlier than taking motion, the agent attracts upon the ReasoningBank to collect related reminiscences into its context. It then interacts with the setting and makes use of an LLM-as-a-judge to self-assess the ensuing trajectory and extracts success insights or failure reflection. Notably, this self-judgement doesn’t must be completely correct, as we discover ReasoningBank to be fairly strong in opposition to judgment noise. Throughout extraction, the agent distills workflows and generalizable insights from the trajectory into new reminiscences. For simplicity, we immediately append these to the ReasoningBank, leaving extra subtle consolidation methods for future work.
Crucially, in contrast to present workflow reminiscence methods that solely deal with profitable runs, ReasoningBank actively analyzes failed experiences to supply counterfactual indicators and pitfalls. By distilling these errors into preventative classes, ReasoningBank builds highly effective strategic guardrails. For instance, as a substitute of merely studying a procedural rule like “click on the ‘Load Extra’ button”, the agent may be taught from a previous failure to “all the time confirm the present web page identifier first to keep away from infinite scroll traps earlier than making an attempt to load extra outcomes”.
