Large Language Model (LLM)

YouTube search... ...Google search

• ChatGPT | OpenAI
  • ChatGPT is everywhere. Here’s where it came from | Will Douglas Heaven - MIT Technology Review
    • Transformer / Attention Mechanism
    • Generative Pre-trained Transformer (GPT)
    • Reinforcement Learning (RL) from Human Feedback (RLHF)
    • Supervised Learning
    • Proximal Policy Optimization (PPO)
• Alpa ... serving large models like GPT-3 simple, affordable, accessible
• BioGPT ... Microsoft language model trained for biomedical tasks
• BLOOM ... Big Science Language Open-science Open-access Multilingual
• Cedille ... open-source French language model
• Chinchilla | DeepMind
• ctrl ... a Conditional Transformer Language Model for Controllable Generation | Salesforce
• Gopher | DeepMind
• RETRO | DeepMind
• DialogGPT ...Microsoft Releases DialogGPT AI Conversation Model | Anthony Alford - InfoQ - trained on over 147M dialogs
• minGPT | Andrej Karpathy - GitHub
• GLM-130B ... Open Bilingual Pre-Trained Model
• OPT-175B
  • Facebook-owner Meta opens access to AI large language model | Elizabeth Culliford - Reuters] ... Facebook 175-billion-parameter language model - Open Pretrained Transformer
• OpenAI Blog | OpenAI
• Attention Mechanism/Transformer Model
• Generative Pre-trained Transformer (GPT)
• SambaNova Systems ... Dataflow-as-a-Service GPT