PRIMO.ai

If you get a 503 error please try the webpage again, as your message is visiting the island which the server is located and may decide to relax in the Sun and may not want to return right away. Thank you.

Overview

• How do I leverage AI?
• Courses
• Reading Material

Background

• What is AI?
• History of AI
• Current State

AI Breakthroughs

• Case Studies
• Capabilities
• AI Patents after 2013

AI Fun

• Google AI Experiments
• TensorFlow Playground
• TensorFlow.js Demos

How to...

• AI Solver
• Strategy & Tactics
• Checklists

Forward Thinking

• Moonshots
• Journey to Singularity
• Creatives

Algorithms

• About Algorithms & Neural Network Models

Supervised

Labeled (desired solution) data is fed into the algorithm. The training data set has inputs as well as the desired output. During the training session, the model will adjust its variables to map inputs to the corresponding output.

• ...predict values
  • Linear Regression
  • Bayesian Linear Regression
  • Support Vector Regression (SVR)
  • Ordinal Regression
  • Poisson Regression
  • Tree-based...
    • Fast Forest Quantile Regression
    • Decision Forest Regression
  • Boosted Decision Tree Regression
  • General Regression Neural Network (GRNN)

• Anomaly Detection ...find outliers
  • One-class Support Vector Machine (SVM)
  • Principal Components Analysis (PCA)-based Anomaly Detection

• Classification ...predict categories
  • Perceptron (P) ...and Multi-layer Perceptron (MLP)
    • Feed Forward Neural Network (FF or FFNN)
    • Artificial Neural Network (ANN)
    • Deep Neural Network (DNN)
  • Support Vector Machine (SVM)
  • K-Nearest Neighbors (KNN)
  • Logistic Regression
  • Naive Bayes
  • Tree-based...
    • Boosted Decision Tree
    • Random Forest (or) Random Decision Forest
    • Decision Jungle

• Other
  • Hopfield Network (HN)
  • Energy-based Model (EBN)
  • Markov Model (Chain, Discrete Time, Continuous Tme, Hidden)

Convolutional; Image & Object Recognition

• (Deep) Convolutional Neural Network (DCNN/CNN)
• (Deep) Residual Network (DRN) - ResNet
  • ResNet-50

Deonvolutional

• Deconvolutional Neural Network (DN) / Inverse Graphics Network (IGN)

Sequence

• Attention Model
• Sequence to Sequence (Seq2Seq)
• Neural Turing Machine

• Speech Recognition & Text Processing; at character level - time-series analysis
  • Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Recurrent Neural Network (RNN)

• Object Recognition & Text Processing
  • (Tree) Recursive Neural (Tensor) Network (RNTN)

Unsupervised Generative Front-end, Supervised Classification; Image Recognition Back-end

• Deep Belief Network (DBN)

Unsupervised

There is not a target outcome. The algorithms will cluster the data set for different groups. Some uses of Unsupervised Learning are (1) data compression, (2) classification, (3) clustering, and (4) outlier detection

Unsupervised: Probabilistic/Generative

A probability distribution over a set of classes for each input sample. Unlabeled data is classified as (1) conditional probability of the target Y, or (2) conditional probability of the observable X given a target Y

• Classification
  • Radial Basis Function Network (RBFN)

• Clustering
  • Restricted Boltzmann Machine (RBM)
  • Variational Autoencoder (VAE)
  • K-Means
  • Mean-Shift Clustering
  • Density-Based Spatial Clustering of Applications with Noise (DBSCAN)
  • Expectation–Maximization (EM) Clustering using Gaussian Mixture Models (GMM)

• Hierarchical; to include clustering
  • Hierarchical Cluster Analysis (HCA)
  • Hierarchical Clustering; Agglomerative (HAC) & Divisive (HDC)
  • Hierarchical Temporal Memory (HTM)

Competitive

• Generative Adversarial Network (GAN)
• Kohonen Network (KN)/Self Organizing Maps (SOM)

Unsupervised: Non-Probabilistic; e.g. Deterministic

Unlabeled data is fed into the algorithm with the algorithm seperating the feature space and return the class associated with the space where a sample originates from.

• Autoencoder (AE) / Encoder-Decoder
• (Stacked) Denoising Autoencoder (DAE)
• Sparse Autoencoder (SAE)

Semi-Supervised

• Semi-Supervised Learning with Generative Adversarial Network (SSL-GAN)
• Context-Conditional Generative Adversarial Network (CC-GAN)

Reinforcement (RL)

An 'agent' algorithm receives a delayed reward in the next time step to evaluate its previous action. Therefore based on those decisions, the algorithm will train itself based on the success/error of output. In combination with Neural Networks it is capable of solving more complex tasks.

• Markov Decision Process (MDP)
• Deep Reinforcement Learning (DRL)
• Deep Q Learning (DQN)
• Neural Coreference
• State-Action-Reward-State-Action (SARSA)
• Deep Deterministic Policy Gradient (DDPG)
• Trust Region Policy Optimization (TRPO)
• Proximal Policy Optimization (PPO)

Generative

• Generative Query Network (GQN)

Libraries & Frameworks

• Libraries & Frameworks Overview
• Libraries & Frameworks other than TensorFlow

TensorFlow

• TensorFlow Overview & Tutorials
• TensorBoard
• TensorFlow.js
• TensorFlow Playground
• TensorFlow Lite
• TensorFlow Serving
• Related...
  • Keras
  • TFLearn
  • Swift

Techniques

Mathematical Background

• Math for Intelligence

Datasets & Information Analysis

• Datasets
• Data Preprocessing & Feature Exploration

Algorithms

• Backpropagation
• Gradient Boosting Algorithms
• Repositories & Other Algorithms
• Dimensional Reduction Algorithms
  • Pooling

Bag of Tricks

• Activation Functions
• Multiclassifiers; Ensembles and Hybrids; Bagging, Boosting, and Stacking
• Object Detection; Faster R-CNN, YOLO, SSD
• Optimizers
  • Objective vs. Cost vs. Loss vs. Error Function
  • Backpropagation
  • Gradient Descent Optimization & Challenges
  • Parameter Initialization
  • Choosing the Right Metric for Evaluating Machine Learning Models
  • Approach to Bias and Variances
  • Classification Performance
• Hyperparameters
• Visualization
• Transfer Learning
• Pipelines
• Competitions

Coding

• Javascript
• Python
• Other Coding options
• Jupyter Notebooks

Platforms: Machine Learning as a Service (MLaaS)

• Service Capabilities
• Other Platforms

Amazon AWS

• AWS with TensorFlow
• DeepLens - deep learning enabled video camera
  • Getting Started & Project: Object Detection
  • More DeepLens Projects
• AWS Internet of Things (IoT)
  • AWS IoT Button
• AmazonML
• Deep Learning (DL) Amazon Machine Image (AMI) - DLAMI
• FloydHub - training and deploying your DL models
• On-Demand AWS Tech Talks
• AWS Training and Certification

Google Cloud AI

• Google Cloud AI With TensorFlow
• Colaboratory - Jupyter notebooks
• Google Developers Codelabs
• Google AI Experiments
• ML Engine
• Prediction API
• Cloud Vision API - drag & drop picture on webpage
• Learn from ML experts at Google

Kaggle

• Kaggle Overview
• Kaggle Kernels
• Kaggle Competitions
  • Passenger Screening
• Hands-On Data Science Education

Microsoft Azure

• Azure Process
• Azure with TensorFlow
• ML Studio
• Cognitive Services
• AI School

Intel

• Neural Compute Stick (NCS)
• AI Academy

Research & Development

• Explainable Artificial Intelligence
• Natural Language Inference (NLI) and Recognizing Textual Entailment (RTE)
• Connecting Brains
• Cybersecurity
  • Cybersecurity References
  • Defense - Anomaly Detection
  • Offense - Adversarial Threats/Attacks
• Self Learning Artificial Intelligence - AutoML & World Models
  • Evolutionary Computation / Genetic Algorithms
  • 3D Simulation Environments
• Architectures
  • Deep Distributed Q Network Partial Observability
  • Capsule Networks (CapNets)
  • Inside Out - Curious Optimistic Reasoning
  • Messaging & Routing
  • Differentiable Neural Computer (DNC)
  • Processing Units - CPU, GPU, TPU, VPU, FPGA, QPU
• Other Challenges

Other

• Business-Centric Methodology
• Getting Started - MediaWiki