Difference between revisions of "Neural Architecture"
| Line 5: | Line 5: | ||
|description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools | ||
}} | }} | ||
| − | [http://www.youtube.com/results?search_query=Neural+Architecture | + | [http://www.youtube.com/results?search_query=Neural+Architecture+machine+learning YouTube search...] |
| − | [http://www.google.com/search?q=Neural+Architecture | + | [http://www.google.com/search?q=Neural+Architecture+machine+learning ...Google search] |
* [[Automated Machine Learning (AML) - AutoML]] | * [[Automated Machine Learning (AML) - AutoML]] | ||
| + | * [[Evolutionary Computation / Genetic Algorithms]] | ||
* [[Hyperparameter]]s Optimization | * [[Hyperparameter]]s Optimization | ||
* [[Other codeless options, Code Generators, Drag n' Drop]] | * [[Other codeless options, Code Generators, Drag n' Drop]] | ||
* [http://www.engadget.com/2019/03/22/mit-ai-automated-neural-network-design/ MIT’s AI can train neural networks faster than ever before | Christine Fisher - Engadget] | * [http://www.engadget.com/2019/03/22/mit-ai-automated-neural-network-design/ MIT’s AI can train neural networks faster than ever before | Christine Fisher - Engadget] | ||
| + | * [[Hierarchical Temporal Memory (HTM)]] | ||
| + | |||
| + | |||
| + | <youtube>sROrvtXnT7Q</youtube> | ||
| + | <youtube>wL-p5cjDG64</youtube> | ||
| + | <youtube>kn3ae4mg1i8</youtube> | ||
| + | <youtube>mUHHdzPSleQ</youtube> | ||
| + | <youtube>CYUpDogeIL0</youtube> | ||
| + | <youtube>MtuADH7kVeQ</youtube> | ||
| + | |||
| + | |||
| + | = Neural Architecture Search (NAS) = | ||
| + | [http://www.youtube.com/results?search_query=Neural+Architecture+Search+NAS+machine+learning YouTube search...] | ||
| + | [http://www.google.com/search?q=Neural+Architecture+Search+NAS+machine+learning ...Google search] | ||
| + | |||
| + | |||
* [http://en.wikipedia.org/wiki/Neural_architecture_search#NAS_with_Reinforcement_Learning Neural Architecture Search (NAS) with Reinforcement Learning | Wikipedia] | * [http://en.wikipedia.org/wiki/Neural_architecture_search#NAS_with_Reinforcement_Learning Neural Architecture Search (NAS) with Reinforcement Learning | Wikipedia] | ||
* [http://en.wikipedia.org/wiki/Neural_architecture_search#NAS_with_Evolution Neural Architecture Search (NAS) with Evolution | Wikipedia] | * [http://en.wikipedia.org/wiki/Neural_architecture_search#NAS_with_Evolution Neural Architecture Search (NAS) with Evolution | Wikipedia] | ||
* [http://en.wikipedia.org/wiki/Neural_architecture_search#Multi-objective_Neural_architecture_search Multi-objective Neural architecture search | Wikipedia] | * [http://en.wikipedia.org/wiki/Neural_architecture_search#Multi-objective_Neural_architecture_search Multi-objective Neural architecture search | Wikipedia] | ||
* [http://github.com/D-X-Y/awesome-NAS Awesome NAS]; a curated list | * [http://github.com/D-X-Y/awesome-NAS Awesome NAS]; a curated list | ||
| − | |||
Various approaches to NAS have designed networks that are on par or even outperform hand-designed architectures. Methods for NAS can be categorized according to the search space, search strategy and performance estimation strategy used: | Various approaches to NAS have designed networks that are on par or even outperform hand-designed architectures. Methods for NAS can be categorized according to the search space, search strategy and performance estimation strategy used: | ||
| Line 25: | Line 41: | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | + | = Differentiable Neural Computer (DNC) = | |
[[http://www.youtube.com/results?search_query=differentiable+neural+computers+%28DNC%29 YouTube search...]] | [[http://www.youtube.com/results?search_query=differentiable+neural+computers+%28DNC%29 YouTube search...]] | ||
<youtube>r5XKzjTFCZQ</youtube> | <youtube>r5XKzjTFCZQ</youtube> | ||
| − | |||
Revision as of 22:56, 7 April 2020
YouTube search... ...Google search
- Automated Machine Learning (AML) - AutoML
- Evolutionary Computation / Genetic Algorithms
- Hyperparameters Optimization
- Other codeless options, Code Generators, Drag n' Drop
- MIT’s AI can train neural networks faster than ever before | Christine Fisher - Engadget
- Hierarchical Temporal Memory (HTM)
Neural Architecture Search (NAS)
YouTube search... ...Google search
- Neural Architecture Search (NAS) with Reinforcement Learning | Wikipedia
- Neural Architecture Search (NAS) with Evolution | Wikipedia
- Multi-objective Neural architecture search | Wikipedia
- Awesome NAS; a curated list
Various approaches to NAS have designed networks that are on par or even outperform hand-designed architectures. Methods for NAS can be categorized according to the search space, search strategy and performance estimation strategy used:
- The search space defines which type of ANN can be designed and optimized in principle.
- The search strategy defines which strategy is used to find optimal ANN's within the search space.
- Obtaining the performance of an ANN is costly as this requires training the ANN first. Therefore, performance estimation strategies are used obtain less costly estimates of a model's performance. Neural Architecture Search | Wikipedia
Differentiable Neural Computer (DNC)
