Difference between revisions of "PRIMO.ai"
m (→Architecture of Modern Models) |
|||
| (2 intermediate revisions by the same user not shown) | |||
| Line 67: | Line 67: | ||
* [[Retrieval-Augmented Generation (RAG)]] ... grounding generation in retrieved documents rather than relying on what the weights happen to encode | * [[Retrieval-Augmented Generation (RAG)]] ... grounding generation in retrieved documents rather than relying on what the weights happen to encode | ||
* [[Mamba]] ... [[Time#Sequence/Time-based Algorithms|sequence models]] that scale differently than attention does | * [[Mamba]] ... [[Time#Sequence/Time-based Algorithms|sequence models]] that scale differently than attention does | ||
| + | * [[State Space Model (SSM)]] capture the system's internal behavior over time | ||
| + | * [[Foundation Models (FM)]] trained on broad data that can be adapted to a wide range of tasks | ||
== [[Generative AI| Generative AI (Gen AI)]] == | == [[Generative AI| Generative AI (Gen AI)]] == | ||
| Line 300: | Line 302: | ||
Capability and trustworthiness are separate problems, and the second one does not solve itself. These pages cover the constraints that determine whether a working system is one you can actually deploy. | Capability and trustworthiness are separate problems, and the second one does not solve itself. These pages cover the constraints that determine whether a working system is one you can actually deploy. | ||
| − | * [[Risk, Compliance and Regulation]] ... [[Ethics]] ... [[Privacy]] ... [[AI Governance]] | + | * [[Explainable / Interpretable AI]] |
| − | + | * [[Risk, Compliance and Regulation]] ... [[Ethics]] ... [[Privacy]] ... [[Law]] ... [[AI Governance]] ... [[AI Verification and Validation]] | |
| − | + | * [[Data Science]] ... [[Data Governance|Governance]] ... [[Data Preprocessing|Preprocessing]] ... [[Feature Exploration/Learning|Exploration]] ... [[Data Interoperability|Interoperability]] ... [[Algorithm Administration#Master Data Management (MDM)|Master Data Management (MDM)]] ... [[Bias and Variances]] ... [[Benchmarks]] ... [[Datasets]] | |
| + | * [[Data Quality]] ... [[AI Verification and Validation|validity]], [[Evaluation - Measures#Accuracy|accuracy]], [[Data Quality#Data Cleaning|cleaning]], [[Data Quality#Data Completeness|completeness]], [[Data Quality#Data Consistency|consistency]], [[Data Quality#Data Encoding|encoding]], [[Data Quality#Zero Padding|padding]], [[Data Quality#Data Augmentation, Data Labeling, and Auto-Tagging|augmentation, labeling, auto-tagging]], [[Data Quality#Batch Norm(alization) & Standardization| normalization, standardization]], [[Data Quality#Imbalanced Data|imbalanced data]] | ||
* [[Constitutional AI]] ... [[Reinforcement Learning (RL) from Human Feedback (RLHF)]] ... [[Policy]] | * [[Constitutional AI]] ... [[Reinforcement Learning (RL) from Human Feedback (RLHF)]] ... [[Policy]] | ||
* [[Cybersecurity]] ... [[Prompt Injection Attack]] ... [[Integrity Forensics]] | * [[Cybersecurity]] ... [[Prompt Injection Attack]] ... [[Integrity Forensics]] | ||
Latest revision as of 06:54, 13 September 2026
On Sunday September 13, 2026 PRIMO.ai has 819 pages
Primo.ai provides links to articles and videos on Artificial intelligence (AI) concepts and techniques such as Generative AI, Natural Language Processing (NLP), Computer Vision, Deep Learning, Reinforcement Learning (RL), and Quantum Technology -- providing perspectives for individuals who are passionate about learning and developing new skills.
Getting Started
- How do I leverage Artificial Intelligence (AI)?
- What is Artificial Intelligence (AI)?
- Current State
- Capabilities ... what AI can do today, mapped by input and output ... Case Studies ... how organizations have actually applied it
- Enjoy the short story Three-Second Pause ... Can Meaning Exist in Artificial Systems?
Interactive Playgrounds
- Google AI Studio: Direct prototyping sandbox for multimodal reasoning over massive context windows (audio, video, text, and code).
- Google Gemini Notebook: generate customizable AI podcast discussions, short visual explainer videos, presentation slide decks with talking points, written reports, interactive study aids, and organized data visualizations.
- Claude Artifacts ... examples for sharing, get inspired to create or remix amazing artifacts with Claude AI Anthropic
- OpenAI Canvas: Dynamic interactive runtimes allowing users to run, render, and iterate on generated HTML5, React, Python, and SVG components in real-time. OpenAI
- Spaces: Community-driven hosting of state-of-the-art Gradio and Streamlit interfaces, supporting zero-GPU client-side execution via WebGPU (Transformers.js) or cloud-hosted tensor accelerators. Hugging Face
Forward Thinking
- Moonshots ... a project or goal that aims to achieve a major breakthrough in artificial intelligence that has the potential to transform society or address significant global challenges
- Artificial General Intelligence (AGI) to Singularity ... a hypothetical future event in which artificial intelligence (AI) surpasses human intelligence in a way that fundamentally changes human society and civilization
- Artificial Intelligence | United States Patent and Trademark Office --> Patent Public Search ... search AI patents by keyword or classification; replaced the retired PatFT/AppFT databases in 2022
- Creatives ... individuals who have significantly contributed to the development, advancement, or popularization of AI
- Books, Radio & Movies - Exploring Possibilities
Information Analysis
- Context ... the next AI frontier
- Data Science ... Governance ... Preprocessing ... Exploration ... Interoperability ... Master Data Management (MDM) ... Bias and Variances ... Benchmarks ... Datasets
- Data Quality ...validity, accuracy, cleaning, completeness, consistency, encoding, padding, augmentation, labeling, auto-tagging, normalization, standardization, and imbalanced data
- Managed Vocabularies
- Excel ... Documents ... Database; Vector & Relational ... Graph ... LlamaIndex ... Retrieval-Augmented Generation (RAG)
- Visualization
- Analytics
- Hyperparameters
- How to ...
- Strategy & Tactics for developing AI investments
- AI Solver for determining possible algorithms for your needs
- Evaluation ... Prompts for assessing AI projects
- Checklists for ensuring consistency and completeness
Algorithms
- Models | Hugging Face ... click on Sort: Trending
- Algorithms; the engines of AI
- Model Zoos
- Graphical Tools for Modeling AI Components
Architecture of Modern Models
Nearly every system described further down this page -- chat assistants, image generators, coding tools, agents -- rests on the same architectural lineage. It is worth reading in order.
- Attention ... the mechanism that lets a model weigh which parts of its input matter for each element it produces
- Transformer ... the architecture built entirely on attention, dispensing with recurrence and convolution
- Generative Pre-trained Transformer (GPT) ... decoder-only transformers pre-trained on broad corpora, then adapted to specific tasks
- Large Language Model (LLM) ... Multimodal ... models that accept and produce more than text
- Retrieval-Augmented Generation (RAG) ... grounding generation in retrieved documents rather than relying on what the weights happen to encode
- Mamba ... sequence models that scale differently than attention does
- State Space Model (SSM) capture the system's internal behavior over time
- Foundation Models (FM) trained on broad data that can be adapted to a wide range of tasks
Generative AI (Gen AI)
The ability to generate new content or solutions, such as writing or designing new products, using techniques such as Generative Adversarial Network (GAN) or neural style transfer.
- Conversational AI ... ChatGPT | OpenAI ... Bing/Copilot | Microsoft ... Gemini | Google ... Claude | Anthropic ... Perplexity ... You ... phind ... Grok | xAI ... Groq ... Ernie | Baidu ... DeepSeek
- Multimodal Language Models
- Video/Image
- Synthesize Speech
- Retrieval-Augmented Generation (RAG) ... Embedding ... Vector Database ... LangChain ... LlamaIndex
- Game Development with Generative AI ... Gaming ... Game-Based Learning (GBL) ... Security ... Generative AI ... Games - Metaverse ... Quantum ... Game Theory ... Design
Predict values - Regression
Analyze large amounts of data and make predictions or recommendations based on that data.
- Linear Regression
- Ridge Regression
- Lasso Regression
- Elastic Net Regression
- Bayesian Linear Regression
- Bayesian Deep Learning (BDL)
- Logistic Regression (LR)
- Support Vector Regression (SVR)
- Ordinal Regression
- Poisson Regression
- Tree-based...
- General Regression Neural Network (GRNN)
- One-class Support Vector Machine (SVM)
- Gradient Boosting Machine (GBM)
Classification ...predict categories
- Supervised
- Naive Bayes
- K-Nearest Neighbors (KNN)
- Perceptron (P) ...and Multi-layer Perceptron (MLP)
- Feed Forward Neural Network (FF or FFNN)
- Neural Network
- Kernel Approximation - Kernel Trick
- Logistic Regression (LR)
- Softmax Regression; Multinominal Logistic Regression
- Tree-based...
- Apriori, Frequent Pattern (FP) Growth, Association Rules/Analysis
- Markov Model (Chain, Discrete Time, Continuous Time, Hidden)
- Unsupervised
- Radial Basis Function Network (RBFN)
- Self-Supervised
- Autoencoder (AE) / Encoder-Decoder
- (Stacked) Denoising Autoencoder (DAE)
- Sparse Autoencoder (SAE) ... also the workhorse of feature-level interpretability research
Recommendation
Clustering - Continuous - Dimensional Reduction
- Singular Value Decomposition (SVD)
- Principal Component Analysis (PCA)
- K-Means
- Fuzzy C-Means (FCM)
- K-Modes
- Association Rule Learning
- Mean-Shift Clustering
- Density-Based Spatial Clustering of Applications with Noise (DBSCAN)
- Expectation–Maximization (EM) Clustering using Gaussian Mixture Models (GMM)
- Restricted Boltzmann Machine (RBM)
- Variational Autoencoder (VAE)
- Biclustering
- Multidimensional Scaling (MDS)
Hierarchical
- Hierarchical Cluster Analysis (HCA)
- Hierarchical Clustering; Agglomerative (HAC) & Divisive (HDC)
- Hierarchical Temporal Memory (HTM) Time
- Mixture Models; Gaussian
Convolutional
Deconvolutional
Graph
- includes social networks, sensor networks, the entire Internet, 3D Objects (Point Cloud)
- Graph Convolutional Network (GCN), Graph Neural Networks (Graph Nets), Geometric Deep Learning
- Point Cloud
- Knowledge Graphs ... increasingly paired with Retrieval-Augmented Generation (RAG) to give retrieval explicit structure
- A hierarchical RNN-based model to predict scene graphs for images
- A multi-granularity reasoning framework for social relation recognition
- Neural Structured Learning (NSL)
Sequence/Time-based Algorithms
- Mamba
- Transformer ... see also Attention
Competitive
- Generative Adversarial Network (GAN)
- Image-to-Image Translation
- Conditional Adversarial Architecture (CAA)
- Kohonen Network (KN)/Self Organizing Maps (SOM)
- Quantum Generative Adversarial Learning (QuGAN - QGAN)
Semi-Supervised
In many practical situations, the cost to label is quite high, since it requires skilled human experts to do that. So, in the absence of labels in the majority of the observations but present in few, semi-supervised algorithms are the best candidates for the model building. These methods exploit the idea that even though the group memberships of the unlabeled data are unknown, this data carries important information about the group parameters. Reference: Learning Techniques
- Semi-Supervised Learning with Generative Adversarial Network (SSL-GAN)
- Context-Conditional Generative Adversarial Network (CC-GAN)
Natural Language
- Natural Language Processing (NLP) involves speech recognition, (speech) translation, understanding (semantic parsing) complete sentences, understanding synonyms of matching words, and sentiment analysis
- Natural Language Generation (NLG)
- Natural Language Classification (NLC)
- Large Language Model (LLM)
- Attention ... Transformer ... Generative Pre-trained Transformer (GPT)
- Natural Language Tools & Services
- Embedding
- Fine-tuning
- Retrieval-Augmented Generation (RAG) (where an external knowledge base is consulted before generating)
- Search (where results are ranked by relevance to a query string)
- Clustering (where text strings are grouped by similarity)
- Recommendations (where items with related text strings are recommended)
- Anomaly Detection (where outliers with little relatedness are identified)
- Classification (where text strings are classified by their most similar label)
- Dimensional Reduction
- ...find outliers ... diversity measurement (where similarity distributions are analyzed)
Reinforcement Learning (RL)
an algorithm receives a delayed reward in the next time step to evaluate its previous action. Therefore based on those decisions, the algorithm will train itself based on the success/error of output. In combination with Neural Networks it is capable of solving more complex tasks. Policy Gradient (PG) methods are a type of reinforcement learning techniques that rely upon optimizing parametrized policies with respect to the expected return (long-term cumulative reward) by gradient descent.
- Monte Carlo (MC) Method - Model Free Reinforcement Learning
- Markov Decision Process (MDP)
- State-Action-Reward-State-Action (SARSA)
- Q Learning
- Deep Reinforcement Learning (DRL) DeepRL
- Distributed Deep Reinforcement Learning (DDRL)
- Evolutionary Computation / Genetic Algorithms
- Actor Critic
- Hierarchical Reinforcement Learning (HRL)
- Reinforcement Learning (RL) from Human Feedback (RLHF) ... the technique that turned raw language models into usable assistants; see also Constitutional AI
Neuro-Symbolic
the “connectionists” seek to construct artificial Neural Networks, inspired by biology, to learn about the world, while the “symbolists” seek to build intelligent machines by coding in logical rules and representations of the world. Neuro-Symbolic combines the fruits of group.
Other
- Hopfield Network (HN)
- Energy-based Model (EBN) ... non-normalized probabilistic model
- Generative Query Network (GQN)
Techniques
- Math for Intelligence ... Finding Paul Revere
- Arxiv Sanity Preserver to accelerate research
- Theory-free Science
Methods & Concepts
- Backpropagation
- Stochastic Gradient Descent
- Learning Rate Decay
- Max Pooling
- Batch Normalization
- Overfitting Challenge
- Manifold Hypothesis and Dimensional Reduction; identification - what influences an observed outcome
- Activation Functions
- Memory
- Multiclassifiers; Ensembles and Hybrids; Bagging, Boosting, and Stacking
- Optimizers
- Neural Network Pruning
- Quantization ... shrinking model precision so larger models fit on smaller hardware
- Repositories & Other Algorithms
- Benchmarks ... Evaluation ... Evaluation - Measures
- MLPerf | MLCommons ... the industry-standard suite for training and inference performance, covering datacenter, edge, client, and tiny deployments
- DAWNBench ... an end-to-end deep learning benchmark and competition; archived, submissions closed in 2020 and the effort was consolidated into MLPerf, but the historical results remain a useful record of how fast training costs fell
- Knowledge Graphs
- Causation vs. Correlation
- Deep Features
- Local Features
- Unintended Feedback Loop
- Backtesting
- Digital Twin
Policy
- Policy ... Policy vs Plan ... Constitutional AI ... Trust Region Policy Optimization (TRPO) ... Policy Gradient (PG) ... Proximal Policy Optimization (PPO)
Learning Techniques
- In-Context Learning (ICL) ... Context
- Out-of-Distribution (OOD) Generalization
- Supervised Learning ... Semi-Supervised Learning ... Self-Supervised Learning ... Unsupervised Learning
- Reinforcement Learning (RL)
- Reinforcement Learning (RL) from Human Feedback (RLHF)
- Deep Learning
- Transfer Learning a model trained on one task is re-purposed on a second related task
- Few Shot Learning ... One-Shot Learning ... Zero-Shot Learning
- Ensemble Learning
- Multi-Task Learning (MTL)
- Apprenticeship Learning - Inverse Reinforcement Learning (IRL)
- Imitation Learning (IL)
- Lifelong Learning - Catastrophic Forgetting Challenge
- Neural Structured Learning (NSL)
- Meta-Learning
- Online Learning
- Human-in-the-Loop (HITL) Learning / Active Learning
- Decentralized: Federated & Distributed Learning
- Multimodal Machine Learning
- Action Learning ... Embodied AI
- Simulated Environment Learning
Trust, Safety & Governance
Capability and trustworthiness are separate problems, and the second one does not solve itself. These pages cover the constraints that determine whether a working system is one you can actually deploy.
- Explainable / Interpretable AI
- Risk, Compliance and Regulation ... Ethics ... Privacy ... Law ... AI Governance ... AI Verification and Validation
- Data Science ... Governance ... Preprocessing ... Exploration ... Interoperability ... Master Data Management (MDM) ... Bias and Variances ... Benchmarks ... Datasets
- Data Quality ... validity, accuracy, cleaning, completeness, consistency, encoding, padding, augmentation, labeling, auto-tagging, normalization, standardization, imbalanced data
- Constitutional AI ... Reinforcement Learning (RL) from Human Feedback (RLHF) ... Policy
- Cybersecurity ... Prompt Injection Attack ... Integrity Forensics
- Government Services ... National Institute of Standards and Technology (NIST) ... U.S. Department of Homeland Security (DHS) ... Defense
- Human-in-the-Loop (HITL) Learning ... keeping a person in the decision path where the stakes justify the cost
Opportunities & Challenges
- Generative AI
- Inside Out - Curious Optimistic Reasoning
- Nature
- Connecting Brains
- Architectures
- Deep Distributed Q Network Partial Observability
- Graph Convolutional Network (GCN), Graph Neural Networks (Graph Nets), Geometric Deep Learning
- Capsule Networks (CapNets)
- Messaging & Routing
- Processing Units - CPU, GPU, APU, TPU, VPU, FPGA, QPU ... compute availability is now a first-order constraint on what gets built
- Integrity Forensics
- Metaverse
- Omniverse
- Cybersecurity
- Robotics ... Embodied AI
- Other Challenges in Artificial Intelligence
- Quantum
Development & Implementation
- Tool Assist | AI Top Tools ... largest directory of AI Tools, Ranked with dynamic algorithms
- Development
- Building Your Environment
- Algorithm Administration
- ChatGPT Integration
- Game Development with Generative AI ... Gaming ... Game-Based Learning (GBL) ... Security ... Generative AI ... Games - Metaverse ... Quantum ... Game Theory ... Design
- Agents ... Robotic Process Automation ... Assistants ... Personal Companions ... Productivity ... Email ... Negotiation ... LangChain ... LlamaIndex
- Retrieval-Augmented Generation (RAG) ... Embedding ... Fine-tuning ... Vector Database ... the usual alternative to retraining when a system needs current or proprietary knowledge
- Service Capabilities
- AI Marketplace & Toolkit/Model Interoperability
No Coding
- Automated Learning
- Neural Architecture Search (NAS) Algorithm
- Codeless Options, Code Generators, Drag n' Drop
Coding
- AI Pair Programming Tools
- Python ... GenAI w/ Python ... JavaScript ... GenAI w/ JavaScript ... TensorFlow ... PyTorch
- R Project
- Other Coding options
Libraries & Frameworks
TensorFlow
- TensorBoard
- TensorFlow Playground
- TensorFlow.js on tensorflow.org ... tutorials, models, and browser demos
- TensorFlow.js
- TensorFlow Lite
- TensorFlow Serving
- Related...
Tooling
- Model Search
- Model Monitoring
- Notebooks; Jupyter and R Markdown
Platforms: AI/Machine Learning as a Service (AIaaS/MLaaS)
- Amazon AWS
- Apple
- Google Cloud Platform (GCP)
- Hugging Face
- IBM
- Intel
- Kaggle
- Microsoft Azure Machine Learning
- Modal
- NVIDIA
- OpenAI
- Palantir
- xAI
... and other leading organizations
- Anthropic
- Meta
- Sakana
- DeepSeek
- Allen Institute for Artificial Intelligence, or AI2
- Government Services
- Stanford University, MIT, UC Berkeley, Carnegie Mellon University, Princeton University, University of Oxford, University of Texas Austin, UCLA, Duke University, EPFL, Harvard University, Cornell University, ETH, Tsinghua University, National University of Singapore, University of Pennsylvania, Technion, University of Washington, UC San Diego, University of Maryland, Peking University, Georgia Institute of Technology, University of Illinois at Urbana-Champaign, University of Wisconsin Madison, University of Toronto, Université de Montréal - Mila, KAIST, Texas A&M University, RIKEN, University of Cambridge, Columbia University, UMass Amherst, National Institute for Research in Digital Science and Technology (INRIA), New York University, University College London, University of Southern California, Yale University, Yandex, Shanghai Jiao Tong University, University of Minnesota, University of Chicago, McGill University, Seoul National University, University of Tuebingen, University of Alberta, Rice University, Johns Hopkins University
If you get a 502 or 503 error please try the webpage again, as your message is visiting the island which the server is located, perhaps deciding to relax in the Sun before returning. Thank you.