Large Language Model (LLM)

YouTube search... ...Google search

• Natural Language Processing (NLP) ...Generation ...LLM ...Tools & Services
• Assistants ... Hybrid Assistants ... Agents ... Negotiation
• Attention Mechanism ...Transformer Model ...Generative Pre-trained Transformer (GPT)
• Models:
  • AlexaTM | Amazon 20B
  • Alpa ... serving large models like GPT-3 simple, affordable, accessible
  • Bidirectional Encoder Representations from Transformers (BERT) 340M
  • BioGPT ... Microsoft language model trained for biomedical tasks
  • BLOOM ... Big Science Language Open-science Open-access Multilingual ... 176B
  • Cedille ... open-source French language model 6B
  • ChatGPT | OpenAI
    • ChatGPT is everywhere. Here’s where it came from | Will Douglas Heaven - MIT Technology Review
      • Attention Mechanism ...Transformer Model ...Generative Pre-trained Transformer (GPT)
      • Reinforcement Learning (RL) from Human Feedback (RLHF)
      • Supervised Learning
      • Proximal Policy Optimization (PPO)
  • Chinchilla | DeepMind 70B
  • ctrl ... a Conditional Transformer Language Model for Controllable Generation | Salesforce
  • Codex | OpenAI ... translates natural language into code
  • Dataflow-as-a-Service | SambaNova
  • DialogGPT ...Microsoft Releases DialogGPT AI Conversation Model | Anthony Alford - InfoQ - trained on over 147M dialogs
  • Flamingo | DeepMind ... Flamingo Pytorch 80B
  • GLM-130B ... Open Bilingual Pre-Trained Model 130B
  • GLaM | Google
  • Gopher | DeepMind 280B
  • GShard | Google ... Scaling Giant Models with Conditional Computation and Automatic Sharding
  • GPT-2 | OpenAI 1.5B
  • GPT-3 | OpenAI 175B
  • GPT-Neo ... Open-source GPT-3 by EleutherAI 20B
  • InstructGPT ... OpenAI 1.3B InstructGPT model over outputs from a 175B GPT-3 model
  • Jurassic-1 ... huge 178B language model to rival OpenAI's GPT-3
  • LaMDA | Google ... experimental language model 137B
  • LLaMA ... Large Language Model Meta AI, 13B and 65B parameter versions
  • Luminous ... Europe 200B
  • Macaw | AI2 11B
  • Med-PaLM ... aligned to the medical domain
  • Megatron ... Monolithic Transformer Language NLP Model 11B
  • minGPT | Andrej Karpathy - GitHub
  • Muse ... VLM-4, a set of natively trained large Language Models in French, Italian, Spanish, German, and English
  • MT-NLG 530B
  • nanoGPT ... for training/finetuning medium-sized GPTs
  • NLLB | Meta 54.5B & 200B parameters; NLLB-200
  • OpenGPT-X ... model for Europe
  • OPT-175B...Facebook-owner Meta opens access to AI large language model | Elizabeth Culliford - Reuters ... Facebook 175B ... BlenderBot 175B
  • Palmyra | Hugging Face ... a privacy-first LLM for enterprises
  • Pathways Language Model (PaLM) 540B
  • PLATO-XL | Baidu ... 11B
  • RETRO | DeepMind
  • Switch Transformers | Google Brain ... trillion parameters
  • Textless NLP ... Generating expressive speech from raw audio
  • T0pp | Hugging Face
  • Toolformer | Meta ... models can teach themselves to use tools and APIs
  • Turing-NLG | Microsoft
  • UnifiedQA ... single QA system
  • WebGPT ... GPT-3 version that can search the web
  • Wu Dao 1.0 (Enlightment 1.0) ... China’s first homegrown super-scale intelligent model
  • XGLM | Hugging Face 7.5B
  • YaLM ... Yandex YaLM 100B
  • Yuan 1.0 | Inspur ... 245B

Inside language models (from GPT-3 to PaLM) | Alan-D-Thompson