Difference between revisions of "Memory Networks"
m (→How are Memories Stored in Neural Networks?) |
m (→How are Memories Stored in Neural Networks?) |
||
| Line 37: | Line 37: | ||
* <b>Semantic</b> memory is someone’s long-term store of knowledge: It’s composed of pieces of information such as facts learned in school, what concepts mean and how they are related, or the definition of a particular word. The details that make up semantic memory can correspond to other forms of memory. One may remember factual details about a party, for instance—what time it started, at whose house it took place, how many people were there, all part of semantic memory—in addition to recalling the sounds heard and excitement felt. But semantic memory can also include facts and meanings related to people, places, or things one has no direct relation to. | * <b>Semantic</b> memory is someone’s long-term store of knowledge: It’s composed of pieces of information such as facts learned in school, what concepts mean and how they are related, or the definition of a particular word. The details that make up semantic memory can correspond to other forms of memory. One may remember factual details about a party, for instance—what time it started, at whose house it took place, how many people were there, all part of semantic memory—in addition to recalling the sounds heard and excitement felt. But semantic memory can also include facts and meanings related to people, places, or things one has no direct relation to. | ||
* <b>Procedural</b> memory is the memory of how to perform certain actions or tasks. It is sometimes referred to as “muscle memory” because it often involves physical actions such as riding a bike or playing a musical instrument. Procedural memory is typically acquired through repetition and practice and is often resistant to forgetting. | * <b>Procedural</b> memory is the memory of how to perform certain actions or tasks. It is sometimes referred to as “muscle memory” because it often involves physical actions such as riding a bike or playing a musical instrument. Procedural memory is typically acquired through repetition and practice and is often resistant to forgetting. | ||
| − | * <Associative> memory specifically deals with remembering the relationship between different objects or concepts. For example, remembering the name of someone or the aroma of a particular perfume would be an example of associative memory. Associative Memory refers to the ability to remember relationships between concepts, and not just the individual concepts themselves. In humans, this relates to visual and verbal information, such as remembering how two words are related (e.g., man – woman), or seeing an object and its alternate name (e.g., a guitar). Associative memory is thought to be mediated by the medial temporal lobe of the brain. | + | * <b>Associative</b> memory specifically deals with remembering the relationship between different objects or concepts. For example, remembering the name of someone or the aroma of a particular perfume would be an example of associative memory. Associative Memory refers to the ability to remember relationships between concepts, and not just the individual concepts themselves. In humans, this relates to visual and verbal information, such as remembering how two words are related (e.g., man – woman), or seeing an object and its alternate name (e.g., a guitar). Associative memory is thought to be mediated by the medial temporal lobe of the brain. |
<youtube>piF6D6CQxUw</youtube> | <youtube>piF6D6CQxUw</youtube> | ||
Revision as of 09:41, 20 May 2023
YouTube search... ...Google search
- Attention Mechanism ...Transformer ...Generative Pre-trained Transformer (GPT) ... GAN ... BERT
- Feature Exploration/Learning
- Architectures
- Control of Memory, Active Perception, and Action in Minecraft | J. Oh, V. Chockalingam, S. Singh, & H. Lee
- Memory-based reinforcement learning algorithm for autonomous exploration in unknown environment | Amir Ramezani Dooraki & Deok Jin Lee
- Deep Reinforcement Learning (DRL)
- MERLIN: Inside Out - Curious Optimistic Reasoning
- A Beginner's Guide to Attention Mechanisms and Memory Networks | Skymind
- Task-Oriented Conversation Generation Using Heterogeneous Memory Networks | Z. Lin, X. Huang, F. Ji, H. Chen, & Y. Zhang
How are Memories Stored in Neural Networks?
There are several types of memory, including episodic memory, semantic memory, and procedural memory.
- Episodic memory is when a person recalls a particular event experienced in the past. This kind of long-term memory brings to attention details about anything from what one ate for breakfast to the emotions that were stirred up during a serious conversation with a romantic partner. The experiences conjured by episodic memory can be very recent or decades-old. A related concept is autobiographical memory, which is the memory of information that forms part of a person’s life story. However, while autobiographical memory includes memories of events in one’s life (such as one’s sixteenth birthday party), it can also encompass facts (such as one’s birth date) and other non-episodic forms of information.
- Semantic memory is someone’s long-term store of knowledge: It’s composed of pieces of information such as facts learned in school, what concepts mean and how they are related, or the definition of a particular word. The details that make up semantic memory can correspond to other forms of memory. One may remember factual details about a party, for instance—what time it started, at whose house it took place, how many people were there, all part of semantic memory—in addition to recalling the sounds heard and excitement felt. But semantic memory can also include facts and meanings related to people, places, or things one has no direct relation to.
- Procedural memory is the memory of how to perform certain actions or tasks. It is sometimes referred to as “muscle memory” because it often involves physical actions such as riding a bike or playing a musical instrument. Procedural memory is typically acquired through repetition and practice and is often resistant to forgetting.
- Associative memory specifically deals with remembering the relationship between different objects or concepts. For example, remembering the name of someone or the aroma of a particular perfume would be an example of associative memory. Associative Memory refers to the ability to remember relationships between concepts, and not just the individual concepts themselves. In humans, this relates to visual and verbal information, such as remembering how two words are related (e.g., man – woman), or seeing an object and its alternate name (e.g., a guitar). Associative memory is thought to be mediated by the medial temporal lobe of the brain.
