Chain of Thought (CoT)

From
Revision as of 12:13, 25 May 2023 by BPeat (talk | contribs) (Tree of Thoughts (ToT))
Jump to: navigation, search

YouTube ... Quora ...Google search ...Google News ...Bing News

AI can generate text that follows a logical and coherent sequence of ideas, building on previous statements to form a chain of thought.


Tree of Thoughts (ToT)

"Tree of Thoughts" is a new framework for inferencing language models like GPT-4, inspired by prompt engineering methods like Chain of Thought. It is a novel approach aimed at improving the problem-solving capabilities of auto-regressive Large Language Model (LLM)s by allowing them to explore multiple reasoning paths over thoughts. To implement ToT as a software system, an LLM is augmented with additional modules including a prompter agent, a checker module, a memory module, and a ToT controller. These modules engage in a multi-round conversation with the LLM to solve a given problem. The memory module records the conversation and state history of the problem-solving process, which allows the system to backtrack to previous steps of the thought-process and explore other directions from there.