Difference between revisions of "PRIMO.ai"
(→Methods) |
(→Methods) |
||
| Line 199: | Line 199: | ||
* Memory | * Memory | ||
** [[Attention Mechanism/Model - Transformer Model]] | ** [[Attention Mechanism/Model - Transformer Model]] | ||
| + | ** [[Transformer-XL]] | ||
** [[Memory Networks]] | ** [[Memory Networks]] | ||
* [[Multiclassifiers; Ensembles and Hybrids; Bagging, Boosting, and Stacking]] | * [[Multiclassifiers; Ensembles and Hybrids; Bagging, Boosting, and Stacking]] | ||
Revision as of 17:24, 19 January 2019
On Friday March 27, 2026 PRIMO.ai has 825 pages
Contents
- 1 Getting Started
- 2 Datasets & Information Analysis
- 3 Algorithms
- 3.1 Predict values - Regression
- 3.2 Classification ...predict categories
- 3.3 Clustering - Continuous - Dimensional Reduction
- 3.4 Convolutional; Image & Object Recognition
- 3.5 Sequence / Time
- 3.6 Competitive
- 3.7 Semi-Supervised
- 3.8 Natural Language Processing (NLP)
- 3.9 Reinforcement Learning (RL)
- 3.10 Other
- 4 Techniques
- 5 Development & Implementation
- 6 Research
Getting Started
Overview
Background
AI Breakthroughs
AI Fun
- Google AI Experiments
- TensorFlow Playground
- TensorFlow.js Demos
- Do-it-yourself artificial intelligence | AIY
- Competitions
How to...
Forward Thinking
Datasets & Information Analysis
- Datasets
- Batch Norm(alization) & Standardization
- Data Preprocessing & Feature Exploration/Learning
- Hyperparameters
- Data Augmentation
- Visualization
- Master Data Management (MDM) / Feature Store / Data Lineage / Data Catalog
Algorithms
- About Algorithms & Neural Network Models
- Discriminative vs. Generative
- Intersection of Artificial Intelligence and Architecture | Raj Ramesh
Predict values - Regression
- Linear Regression
- Ridge Regression
- Bayesian Linear Regression
- Support Vector Regression (SVR)
- Ordinal Regression
- Poisson Regression
- Tree-based...
- General Regression Neural Network (GRNN)
- One-class Support Vector Machine (SVM)
- Gradient Boosting Machine (GBM)
Classification ...predict categories
- Supervised
- Naive Bayes
- K-Nearest Neighbors (KNN)
- Perceptron (P) ...and Multi-layer Perceptron (MLP)
- Feed Forward Neural Network (FF or FFNN)
- Artificial Neural Network (ANN)
- Deep Neural Network (DNN)
- Kernel Approximation
- Logistic Regression (LR)
- Tree-based...
- Apriori, Frequent Pattern (FP) Growth, Association Rules/Analysis
- Markov Model (Chain, Discrete Time, Continuous Tme, Hidden)
- Unsupervised
Recommendation
Clustering - Continuous - Dimensional Reduction
- Singular Value Decomposition (SVD)
- Principal Component Analysis (PCA)
- K-Means
- K-Modes
- Association Rule Learning
- Mean-Shift Clustering
- Density-Based Spatial Clustering of Applications with Noise (DBSCAN)
- Expectation–Maximization (EM) Clustering using Gaussian Mixture Models (GMM)
- Restricted Boltzmann Machine (RBM)
- Variational Autoencoder (VAE)
Hierarchical
- Hierarchical Cluster Analysis (HCA)
- Hierarchical Clustering; Agglomerative (HAC) & Divisive (HDC)
- Hierarchical Temporal Memory (HTM) Time
- Mixture Models; Gaussian
Convolutional; Image & Object Recognition
Graph Convolutional Network (GCN), Graph Neural Networks (Graph Nets), Geometric Deep Learning
- includes social networks, sensor networks, the entire Internet, 3D Objects (point cloud)
Deconvolutional
Sequence / Time
- Sequence to Sequence (Seq2Seq)
- Neural Turing Machine
- Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Recurrent Neural Network (RNN)
- (Tree) Recursive Neural (Tensor) Network (RNTN)
Time
- Temporal Difference (TD) Learning
- Predict values
Spatialtemporal
Spatial-Temporal Dynamic Network (STDN)
Competitive
- Generative Adversarial Network (GAN)
- Conditional Adversarial Architecture (CAA)
- Kohonen Network (KN)/Self Organizing Maps (SOM)
Semi-Supervised
In many practical situations, the cost to label is quite high, since it requires skilled human experts to do that. So, in the absence of labels in the majority of the observations but present in few, semi-supervised algorithms are the best candidates for the model building. These methods exploit the idea that even though the group memberships of the unlabeled data are unknown, this data carries important information about the group parameters.
- Semi-Supervised Learning with Generative Adversarial Network (SSL-GAN)
- Context-Conditional Generative Adversarial Network (CC-GAN)
Natural Language Processing (NLP)
Challenges involve Speech recognition, (speech) translation, understanding (semantic parsing) complete sentences, understanding synonyms of matching words, sentiment analysis, and writing/generating complete grammatically correct sentences and paragraphs
Reinforcement Learning (RL)
an algorithm receives a delayed reward in the next time step to evaluate its previous action. Therefore based on those decisions, the algorithm will train itself based on the success/error of output. In combination with Neural Networks it is capable of solving more complex tasks.
- Markov Decision Process (MDP)
- Deep Reinforcement Learning (DRL)
- Deep Q Learning (DQN)
- Neural Coreference
- State-Action-Reward-State-Action (SARSA)
- Deep Deterministic Policy Gradient (DDPG)
- Trust Region Policy Optimization (TRPO)
- Proximal Policy Optimization (PPO)
- Hierarchical Reinforcement Learning (HRL)
Other
Techniques
Foundation
- Math for Intelligence
- Arxiv Sanity Preserver to accelerate research
Methods
- Backpropagation
- Gradient Boosting Algorithms
- Overfitting Challenge
- Softmax
- Dimensional Reduction Algorithms; what influences an observed outcome
- Activation Functions
- Memory
- Multiclassifiers; Ensembles and Hybrids; Bagging, Boosting, and Stacking
- Object Detection; Faster R-CNN, YOLO, SSD
- Optimizers
- Few Shot Learning
- Multitask Learning
- Transfer Learning a model trained on one task is re-purposed on a second related task
- Repositories & Other Algorithms
Development & Implementation
Libraries & Frameworks
TensorFlow
- TensorFlow Overview & Tutorials
- TensorBoard
- TensorFlow.js
- TensorFlow Playground
- TensorFlow Lite
- TensorFlow Serving
- Related...
Tooling
Coding
Platforms: Machine Learning as a Service (MLaaS)
Google Cloud Platform (GCP) ...AI with TensorFlow
- Kubeflow ML workflows on Kubernetes
- Colaboratory - Jupyter notebooks
- Google Developers Codelabs
- Dopamine - reinforcement learning algorithms
- Google AI Experiments
- ML Engine
- Prediction API
- Cloud Vision API - drag & drop picture on webpage
- Grow with Google
- Learn from ML experts at Google
Amazon AWS
- AWS with TensorFlow
- DeepLens - deep learning enabled video camera
- AWS Internet of Things (IoT)
- AmazonML
- Deep Learning (DL) Amazon Machine Image (AMI) - DLAMI
- FloydHub - training and deploying your DL models
- On-Demand AWS Tech Talks
- AWS Training and Certification
Microsoft Azure
NVIDIA
Kaggle
Intel
Apple
Research
- Generative Modeling
- Automated Machine Learning (AML) - AutoML
- Explainable Artificial Intelligence (EAI)
- AI Marketplace & Toolkit/Model Interoperability
- Self Learning Artificial Intelligence - AutoML & World Models
- Bio-inspired Computing
- Connecting Brains
- Architectures
- Cybersecurity
- Integrity Forensics
- Other Challenges
If you get a 502 or 503 error please try the webpage again, as your message is visiting the island which the server is located, perhaps deciding to relax in the Sun before returning. Thank you.