View source for Large Language Model (LLM)

{{#seo:
|title=PRIMO.ai
|titlemode=append
|keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Gemini, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools  

<!-- Google tag (gtag.js) -->
<script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script>
<script>
  window.dataLayer = window.dataLayer || [];
  function gtag(){dataLayer.push(arguments);}
  gtag('js', new Date());

  gtag('config', 'G-4GCWLBVJ7T');
</script>
}}
[https://www.youtube.com/results?search_query=ai+Large+Language+Model+LLM YouTube]
[https://www.quora.com/search?q=ai%20Large%20Language%20LLM ... Quora]
[https://www.google.com/search?q=ai+Large+Language+Model+LLM ...Google search]
[https://news.google.com/search?q=ai+Large+Language+Model+LLM ...Google News]
[https://www.bing.com/news/search?q=ai+Large+Language+Model+LLM&qft=interval%3d%228%22 ...Bing News]

* [[Large Language Model (LLM)]] ... [[Large Language Model (LLM)#Multimodal|Multimodal]] ... [[Foundation Models (FM)]] ... [[Generative Pre-trained Transformer (GPT)|Generative Pre-trained]] ... [[Transformer]] ... [[GPT-4]] ... [[GPT-5]] ... [[Attention]] ... [[Generative Adversarial Network (GAN)|GAN]] ... [[Bidirectional Encoder Representations from Transformers (BERT)|BERT]]
* [[Natural Language Processing (NLP)]] ... [[Natural Language Generation (NLG)|Generation (NLG)]] ... [[Natural Language Classification (NLC)|Classification (NLC)]] ... [[Natural Language Processing (NLP)#Natural Language Understanding (NLU)|Understanding (NLU)]] ... [[Language Translation|Translation]] ... [[Summarization]] ... [[Sentiment Analysis|Sentiment]] ... [[Natural Language Tools & Services|Tools]]
* [[Embedding]] ... [[Fine-tuning]] ... [[Retrieval-Augmented Generation (RAG)|RAG]] ... [[Agents#AI-Powered Search|Search]] ... [[Clustering]] ... [[Recommendation]] ... [[Anomaly Detection]] ... [[Classification]] ... [[Dimensional Reduction]].  [[...find outliers]]
* [[What is Artificial Intelligence (AI)? | Artificial Intelligence (AI)]] ... [[Generative AI]] ... [[Machine Learning (ML)]] ... [[Deep Learning]] ... [[Neural Network]] ... [[Reinforcement Learning (RL)|Reinforcement]] ... [[Learning Techniques]]
* [[Conversational AI]] ... [[ChatGPT]] | [[OpenAI]] ... [[Bing/Copilot]] | [[Microsoft]] ... [[Gemini]] | [[Google]] ... [[Claude]] | [[Anthropic]] ... [[Perplexity]] ... [[You]] ... [[phind]] ... [[Ernie]] | [[Baidu]]
* [[Cohere]]
* [[Agents]] ... [[Robotic Process Automation (RPA)|Robotic Process Automation]] ... [[Assistants]] ... [[Personal Companions]] ... [[Personal Productivity|Productivity]] ... [[Email]] ... [[Negotiation]] ... [[LangChain]]
* [[Excel]] ... [[LangChain#Documents|Documents]] ... [[Database|Database; Vector & Relational]] ... [[Graph]] ... [[LlamaIndex]]
* [[Video/Image]] ... [[Vision]] ... [[Colorize]] ... [[Image/Video Transfer Learning]]
* [[End-to-End Speech]] ... [[Synthesize Speech]] ... [[Speech Recognition]] ... [[Music]]
* [[Analytics]] ... [[Visualization]] ... [[Graphical Tools for Modeling AI Components|Graphical Tools]] ... [[Diagrams for Business Analysis|Diagrams]] & [[Generative AI for Business Analysis|Business Analysis]] ... [[Requirements Management|Requirements]] ... [[Loop]] ... [[Bayes]] ... [[Network Pattern]]
* [[Development]] ... [[Notebooks]] ... [[Development#AI Pair Programming Tools|AI Pair Programming]] ... [[Codeless Options, Code Generators, Drag n' Drop|Codeless]] ... [[Hugging Face]] ... [[Algorithm Administration#AIOps/MLOps|AIOps/MLOps]] ... [[Platforms: AI/Machine Learning as a Service (AIaaS/MLaaS)|AIaaS/MLaaS]]
* [[Prompt Engineering (PE)]] ... [[Prompt Engineering (PE)#PromptBase|PromptBase]] ... [[Prompt Injection Attack]] 
* [[Artificial General Intelligence (AGI) to Singularity]] ... [[Inside Out - Curious Optimistic Reasoning| Curious Reasoning]] ... [[Emergence]] ... [[Moonshots]] ... [[Explainable / Interpretable AI|Explainable AI]] ...  [[Algorithm Administration#Automated Learning|Automated Learning]]
* [[Chain of Thought (CoT)]]  ... [[Chain of Thought (CoT)#Tree of Thoughts (ToT)|Tree of Thoughts (ToT)]]
* [[Aviary|Aviary ... fully free, cloud-based infrastructure designed to help developers choose and deploy the right technologies and approach for their LLM-based applications.]]
* [[Loss#Loss Curve|Loss Curve]]
* [[Risk, Compliance and Regulation]] ... [[Ethics]] ... [[Privacy]] ... [[Law]] ... [[AI Governance]] ... [[AI Verification and Validation]]
* [https://www.marktechpost.com/2023/04/06/8-potentially-surprising-things-to-know-about-large-language-models-llms/ 8 Potentially Surprising Things To Know About Large Language Models LLMs | Dhanshree Shripad Shenwai - Marketechpost]
* [https://www.marktechpost.com/2023/04/07/this-ai-paper-introduce-self-refine-a-framework-for-improving-initial-outputs-from-llms-through-iterative-feedback-and-refinement/ This AI Paper Introduces SELF-REFINE: A Framework For Improving Initial Outputs From LLMs Through Iterative Feedback And Refinement | Aneesh Tickoo - MarkTechPost]
* [https://www.marktechpost.com/2023/04/11/meet-lmql-an-open-source-programming-language-and-platform-for-large-language-model-llm-interaction/ Meet LMQL: An Open Source Programming Language and Platform for Large Language Model (LLM) Interaction | Tanya Malhotra - MarkTechPost]
* [https://resources.nvidia.com/en-us-conversational-ai-nurture-3/large-language-models-intro-blog What Are Large Language Models Used For? |] [[NVIDIA]]
* [https://bdtechtalks.com/2023/07/14/chatgpt-llm-prompt-architecting/ Does your company need its own LLM? | Jason Ly - TechTalks] ... inspired many to ask how to get their hands on their ‘own LLM’, or sometimes more ambitiously, their ‘own ChatGPT’.
* [https://a16z.com/2023/06/20/emerging-architectures-for-llm-applications/#section--4 Emerging Architectures for LLM Applications | M. Bornstein and R. Radovanovic - Andreessen Horowitz] ... a reference architecture for the emerging LLM app stack
* [https://arstechnica.com/science/2023/07/a-jargon-free-explanation-of-how-ai-large-language-models-work/ A jargon-free explanation of how AI large language models work | Timothy B. Lee & Sean Trot - ARS Technica]
* [https://thebabar.medium.com/essential-guide-to-foundation-models-and-large-language-models-27dab58f7404 Essential Guide to Foundation Models and Large Language Models | Babar M Bhatti - Medium]
* [https://howaibuildthis.substack.com/ How AI Built This Substack] ... covering latest LLM developments
 

<B>Large Language Model (LLM)</b> is a [[Neural Network]] that learns skills, such as generating language and conducting conversations, by analyzing vast amounts of text from across the internet. The [[Neural Network]] with many parameters (typically billions of weights or more), trained on large quantities of unlabeled text using [[Self-Supervised]] Learning or [[Semi-Supervised]] Learning. LLMs use deep neural networks, such as [[Transformer]]s, to learn from billions or trillions of words, and to produce texts on any topic or domain. LLMs are general purpose models which excel at a wide range of tasks, as opposed to being trained for one specific task (such as [[Sentiment Analysis]], [[Natural Language Processing (NLP)#Named Entity Recognition (NER)|Named Entity Recognition (NER)]], or [[Math for Intelligence#Mathematical Reasoning|Mathematical Reasoning]]). They are capable of generating human-like text, from poetry to programming code.


<hr>

<b><i>One of the more interesting, but seemingly academic, concerns of the new era of AI sucking up everything on the web was that AIs will eventually start to absorb other AI-generated content and regurgitate it in a self-reinforcing loop. Not so academic after all, it appears, because [[Bing]] just did it! When asked, it produced verbatim a [[COVID-19]] conspiracy coaxed out of [[ChatGPT]] by disinformation researchers just last month.</i></b> [https://techcrunch.com/2023/02/08/ai-is-eating-itself-bings-ai-quotes-covid-disinfo-sourced-from-chatgpt/ AI is eating itself: Bing’s AI quotes COVID disinfo sourced from ChatGPT | Devin Coldewey, Frederic Lardinois - TechCrunch]

<hr>


= <span id="Multimodal"></span>Multimodal =
* [[Large Language Model (LLM)]] ... [[Large Language Model (LLM)#Multimodal|Multimodal]] ... [[Foundation Models (FM)]] ... [[Generative Pre-trained Transformer (GPT)|Generative Pre-trained]] ... [[Transformer]] ... [[GPT-4]] ... [[GPT-5]] ... [[Attention]] ... [[Generative Adversarial Network (GAN)|GAN]] ... [[Bidirectional Encoder Representations from Transformers (BERT)|BERT]]

Large Multimodal Models (LMM)/Multimodal Language Model (MLM)/Multimodal Large Language Model (MLLM) are a type of Large Language Model (LLM) that combines text with other kinds of information, such as images, videos, audio, and other sensory data1. This allows LMMs to solve some of the problems of the current generation of LLMs and unlock new applications that were impossible with text-only models [https://bdtechtalks.com/2023/03/13/multimodal-large-language-models/ What you need to know about multimodal language models | Ben Dickson - TechTalks]

* [[GPT-4]] | [[OpenAI]]  ... can accept prompts of both text and images1. This means that it can take images as well as text as input, giving it the ability to describe the humor in unusual images, summarize text from screenshots, and answer exam questions that contain diagrams. 1 trillion parameters. 
* [[Kosmos-1]] | [[Microsoft]]  ... can perceive general modalities, learn in [[context]] (i.e., few-shot), and follow instructions (i.e., zero-shot). It can analyze images for content, solve visual puzzles, perform visual text recognition, and pass visual IQ tests. 1.6B
* [[PaLM|PaLM-E]] | [[Google]] ... an Embodied Multimodal Language Model that directly incorporates real-world continuous sensor modalities into language models and thereby establishes the link between words and percepts. It was developed by Google to be a model for robotics and can solve a variety of tasks on multiple types of robots and for multiple modalities (images, robot states, and neural scene representations). [[PaLM|PaLM-E]] is also a generally-capable vision-and-language model. It can perform visual tasks, such as describing images, detecting objects, or classifying scenes, and is also proficient at language tasks, like quoting poetry, solving math equations or generating code. 562B
* [[Gemini]] | [[Google]] ... (Generalized Multimodal Intelligence Network)synergistic network of multiple separate AI models that work in unison to handle an astonishingly wide variety of tasks. >100PB, 1 trillion tokens
* [https://arxiv.org/abs/2302.00923 Multimodal-CoT (Multimodal Chain-of-Thought Reasoning)] [https://github.com/amazon-science/mm-cot GitHub] ... incorporates language (text) and vision (images) modalities into a two-stage framework that separates rationale generation and answer inference. Under 1B
* [[BLIP-2]] | Salesforce Research ... a generic and efficient pre-training strategy that bootstraps vision-language pre-training from off-the-shelf frozen pre-trained image encoders and frozen large language models. It achieves state-of-the-art performance on various vision-language tasks, despite having significantly fewer trainable parameters than existing methods. 

<youtube>helW1httyO8</youtube>

= <span id="Large Language Models (LLM)"></span>Large Language Models (LLM) =
A Large Language Model (LLM) is a type of machine learning model that utilizes deep learning algorithms to process and understand language. They are trained on large amounts of data to learn language patterns so they can perform tasks such as translating texts or responding in chatbot conversations. LLMs are general-purpose models that excel at a wide range of tasks, as opposed to being trained for one specific task. It can be accessed and used through an API or a platform. 

* [https://dataconomy.com/2023/04/best-ai-models-types-how-to-choose-what-is/ Everything you should know about AI models | Eray Eliaçık - Dataconomy]
** [https://www.amazon.science/blog/20b-parameter-alexa-model-sets-new-marks-in-few-shot-learning AlexaTM |] [[Amazon]]  20B
** [https://opt.alpa.ai/ Alpa]  ... serving large models like GPT-3 simple, affordable, accessible 
** [[Bidirectional Encoder Representations from Transformers (BERT)]] 340M
** [https://github.com/microsoft/BioGPT BioGPT]  ... [[Microsoft]] language model trained for biomedical tasks
** [https://www.marktechpost.com/2023/04/05/meet-baize-an-open-source-chat-model-with-parameter-efficient-tuning-on-self-chat-data/ Baize] ... 7B, 13B, 30B & 60B
** [https://bigscience.notion.site/BLOOM-BigScience-176B-Model-ad073ca07cdf479398d5f95d88e218c4 BLOOM]  ... Big Science Language Open-science Open-access Multilingual  ... 176B
** [https://www.marktechpost.com/2023/04/05/meet-bloomberggpt-a-large-language-model-with-50-billion-parameters-that-has-been-trained-on-a-variety-of-financial-data/ BloombergGPT 50B] ... trained financial data
** [https://cedille.ai/ Cedille]  ... open-source French language model  6B
** [[ChatGPT]] | [[OpenAI]]
*** [https://www.technologyreview.com/2023/02/08/1068068/chatgpt-is-everywhere-heres-where-it-came-from/ ChatGPT is everywhere. Here’s where it came from | Will Douglas Heaven - MIT Technology Review]
**** [[Attention]] Mechanism  ...[[Transformer]] Model   ...[[Generative Pre-trained Transformer (GPT)]]
**** [[Reinforcement Learning (RL) from Human Feedback (RLHF)]]
**** [[Supervised]] Learning
**** [[Proximal Policy Optimization (PPO)]]
** [https://www.deepmind.com/publications/an-empirical-analysis-of-compute-optimal-large-language-model-training Chinchilla |] [[Google | DeepMind]]   70B
** [https://arxiv.org/abs/2203.15556 ctrl] ... a Conditional Transformer Language Model for Controllable Generation | Salesforce
** [https://openai.com/ Codex |] [[OpenAI]] ... translates natural language into codeF
** [https://sambanova.ai/solutions/gpt/ Dataflow-as-a-Service | SambaNova]
** [https://www.infoq.com/news/2019/11/microsoft-ai-conversation/ DialogGPT]  ...Microsoft Releases DialogGPT AI Conversation Model | Anthony Alford - InfoQ - trained on over 147M dialogs 
** [https://www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html Dolly |] [[Databricks]] 
** [https://medium.com/syncedreview/deepminds-flamingo-visual-language-model-demonstrates-sota-few-shot-multimodal-learning-f795c3034b94 Flamingo |] [[Google|DeepMind]] ... [https://github.com/lucidrains/flamingo-pytorch Flamingo Pytorch] 80B 
** [[FLAN-T5 LLM | FLAN-T5-XXL |]] [[Goggle]] ... 11B
** [https://sh-tsang.medium.com/brief-review-flan-palm-scaling-instruction-finetuned-language-models-79f47cbcb882 Flan-U-PaLM] [[Google]] ... capable of generating executable [[Python]] code
** [https://github.com/THUDM/GLM-130B GLM-130B]  ... Open Bilingual Pre-Trained Model  130B
** [https://ai.googleblog.com/2021/12/more-efficient-in-context-learning-with.html GLaM |] [[Google]]
** [[Gemini#Gopher | Gopher]] | [[Google | DeepMind]]  280B
** [https://arxiv.org/abs/2006.16668 GShard |] [[Google]]   ... Scaling Giant Models with Conditional Computation and Automatic Sharding
** [https://openai.com/blog/better-language-models/ GPT-2 |] [[OpenAI]]  1.5B
** [https://openai.com/blog/better-language-models/ GPT-3 |] [[OpenAI]] 175B
** [https://github.com/EleutherAI/gpt-neo/ GPT-Neo] ... Open-source GPT-3 by EleutherAI   20B
** HTML-T5 | [[Google]] ... A domain-specific LLM trained on a massive corpus of HTML documents, specializing in understanding and summarizing website content.
** [https://openai.com/blog/instruction-following/ InstructGPT] ... [[OpenAI]] 1.3B InstructGPT model over outputs from a 175B GPT-3 model 
** [https://uploads-ssl.webflow.com/60fd4503684b466578c0d307/61138924626a6981ee09caf6_jurassic_tech_paper.pdf  Jurassic-1] ... huge 178B language model to rival [[OpenAI]]'s GPT-3
** [[Gemini#LaMDA | LaMDA]] | [[Google]]  ... Language Model for Dialogue Applications; experimental language model  137B
** [[LLaMA]] ... Large Language Model [[Meta]] AI, 13B and 65B parameter versions  
** [https://www.aleph-alpha.com/luminous-explore-a-model-for-world-class-semantic-representation Luminous] ... Europe  200B
** [https://github.com/allenai/macaw Macaw | AI2]  11B
** [https://arxiv.org/pdf/2212.13138.pdf Med-PaLM]  ... aligned to the medical domain  ... [[PaLM]]
** [https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/ Megatron] | [[nVidia]] ... Monolithic Transformer Language NLP Model 11B
*** [https://arxiv.org/abs/2201.11990 Megatron Turing (MT-NLG)]  530B
** [https://github.com/karpathy/minGPT minGPT | Andrej Karpathy - GitHub]
** [[Mistral]] ... Mixtral 8x7b ... [[Mixture-of-Experts (MoE)]]
** [https://muse.lighton.ai/home Muse] ... VLM-4, a set of natively trained large Language Models in French, Italian, Spanish, German, and English
** [https://github.com/karpathy/nanoGPT nanoGPT] ... for training/finetuning medium-sized GPTs
** [https://ai.facebook.com/blog/nllb-200-high-quality-machine-translation/ NLLB |] [[Meta]]  54.5B & 200B parameters; NLLB-200
** [https://www.together.xyz/blog/openchatkit OpenChatKit | TogetherCompute] ... The first open-source [[ChatGPT]] alternative released; a 20B chat-GPT model under the Apache-2.0 license, which is available for free on Hugging Face.
** [https://machinelearning.apple.com/research/openelm  OpenELM | Apple]
** [https://idw-online.de/en/news786967 OpenGPT-X]  ... model for Europe
** [https://www.reuters.com/technology/facebook-owner-meta-opens-access-ai-large-language-model-2022-05-03/ OPT-175B]...[[Meta|Facebook]]-owner Meta opens access to AI large language model | Elizabeth Culliford - Reuters ... [[Meta|Facebook]] 175B  ... BlenderBot   175B
** [https://huggingface.co/Writer/palmyra-base  Palmyra |] [[Hugging Face]] ... a privacy-first LLM for enterprises
** [[PaLM]] | [[Google]] ... Pathways Language Model  ... 540B
** [https://news.microsoft.com/source/features/ai/the-phi-3-small-language-models-with-big-potential/ Phi-3] | [[Microsoft]] ... outperform much larger models in math and computer science ... Phi-3-mini 3.8B
** [https://research.baidu.com/Blog/index-view?id=163 PLATO-XL | Baidu]  ... 11B 
** [[RETRO]] | [[Google | DeepMind]] 
** [https://www.marktechpost.com/2023/04/12/hugging-face-introduces-stackllama-a-7b-parameter-language-model-based-on-llama-and-trained-on-data-from-stack-exchange-using-rlhf/ StackLLaMA |] [[Hugging Face]] 7B .. trained with Stack Exchange Using RLHF
** [https://arxiv.org/abs/2101.03961 Switch Transformers |] [[Google]] Brain  ... trillion parameters
** [https://ai.facebook.com/blog/textless-nlp-generating-expressive-speech-from-raw-audio/  Textless NLP  ... Generating expressive speech from raw audio]
** [https://huggingface.co/bigscience/T0pp  T0pp |] [[Hugging Face]]
** [[Toolformer]] | [[Meta]] ... models can teach themselves to use tools and APIs
** [https://turing.microsoft.com/ Turing-NLG |] [[Microsoft]] 
** [https://github.com/allenai/unifiedqa  UnifiedQA]  ... single QA system
** [https://openai.com/blog/webgpt/ WebGPT] ... GPT-3 version that can search the web
** [https://syncedreview.com/2021/03/23/chinas-gpt-3-baai-introduces-superscale-intelligence-model-wu-dao-1-0/   Wu Dao 1.0 (Enlightment 1.0)]   ... China’s first homegrown super-scale intelligent model 
** [https://huggingface.co/docs/transformers/model_doc/xglm  XGLM |] [[Hugging Face]]  7.5B
** [https://github.com/yandex/YaLM-100B YaLM] ... Yandex YaLM 100B 
** [https://arxiv.org/abs/2110.04725 Yuan 1.0 | Inspur]   ... 245B


<img src="https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F647e7326-fb7e-4a95-9f62-06deeba4d72e_3840x2160.png" width="900">

[https://lifearchitect.ai/models/ Inside language models (from GPT-3 to PaLM) | Alan-D-Thompson]  ... [[PaLM]]

= LLM Token / Parameter / Weight =
[https://www.youtube.com/results?search_query=LLM+Token+Parameter+Weight+DGX+Memory+Model YouTube]
[https://www.quora.com/search?q=LLM%20Token%20Parameter%20Weight%20DGX%20Memory%20Model ... Quora]
[https://www.google.com/search?q=LLM+Token+Parameter+Weight+DGX+Memory+Model ... Google search]
[https://news.google.com/search?q=LLM+Token+Parameter+Weight+DGX+Memory+Model ... Google News]
[https://www.bing.com/news/search?q=LLM+Token+Parameter+Weight+DGX+Memory+Model&qft=interval%3d%228%22 ... Bing News]

* [[Embedding]] ... [[Fine-tuning]] ... [[Agents#AI-Powered Search|Search]] ... [[Clustering]] ... [[Recommendation]] ... [[Anomaly Detection]] ... [[Classification]] ... [[Dimensional Reduction]].  [[...find outliers]]
* [[Benchmarks#Large Language Model (LLM) Evaluation|Large Language Model (LLM) Evaluation]] 
* [[ChatGPT#NVIDIA A100 HPC (High-Performance Computing) Accelerator|NVIDIA A100 HPC (High-Performance Computing) Accelerator for ChatGPT]]
* [https://analyticsindiamag.com/leaked-llama-unveils-the-power-of-open-source/ Leaked LLaMA Unveils the Power of Open Source for AI | Anirudh VK - AIM]
* [https://kipp.ly/blog/transformer-param-count/ LLM Parameter Counting | kipply's blob]
* [https://www.anyscale.com/blog/num-every-llm-developer-should-know Numbers every LLM Developer should know | Waleed Kadous - Anyscale]  

In the [[context]] of a large language model (LLM), a token is a basic unit of meaning, such as a word, a punctuation mark, or a number. Parameters are the numerical values that define the behavior of the model. They are adjusted during training to optimize the model's ability to generate relevant and coherent text. Weights are a type of parameter that defines the strength of connections between neurons across different layers in the model. They are adjusted during training to optimize the model's ability to learn relationships between different tokens.

Here is a more detailed explanation of each term:

== <span id="Token"></span>Token ==
* [https://github.com/huggingface/tokenizers tokenizers | HuggingFace]

A token is a basic unit of meaning in a language. In natural language processing, tokens are typically words, but they can also be punctuation marks, numbers, or other symbols. For example, the sentence "The quick brown fox jumps over the lazy dog" contains 13 tokens.
* [https://arxiv.org/abs/2304.11062?utm_source=the-ai-exchange&utm_medium=newsletter&utm_campaign=chatgpt-that-can-handle-1m-tokens Scaling Transformer to 1M tokens and beyond with Recurrent [[Memory]] Transformer (RMT) | A. Bulatov, Y. Kuratov, & M. Burtsev - arXiv - Cornell University] ... Researchers are designing ways for [[ChatGPT]] to do 1M+ <b>tokens</b> by letting the model learn the meaning of groups of tokens instead of only tokens. [[ChatGPT]] only remembers a few thousand tokens (or word chunks) at a time. AKA, it has small short term [[memory]].

== <span id="Parameter"></span>Parameter == 
A parameter is a numerical value that defines the behavior of a model. In the [[context]] of LLMs, parameters are adjusted during training to optimize the model's ability to generate relevant and coherent text. For example, a parameter might define the strength of a connection between two neurons in the model's architecture.

== <span id="Weight"></span>Weight == 
A weight is a type of parameter that defines the strength of connections between neurons across different layers in the model. Weights are adjusted during training to optimize the model's ability to learn relationships between different tokens. For example, a weight might define the strength of the connection between the neuron that represents the token "the" and the neuron that represents the token "quick".
* <b>[[Embedding]]</b> weights: These weights are associated with each token in the vocabulary and are used to represent the semantic meaning of the tokens.
* <b>Self-attention</b> weights: These weights are used to determine the influence of different tokens on each other within a sequence
* <b>Feedforward</b> weights: These weights are used in the feedforward layers of the model to compute the layer's output, which is a part of each block in the large language model (LLM)
* <b>Bias</b> weights: Bias weights are added to the outputs of various layers, including the [[embedding]], self-attention, and feedforward layers, to help the model make more accurate predictions

=== <span id="Sharing"></span>Sharing === 
* [[LLaMA]] | [[Meta]]

Sharing "weights" refers to the distribution of the parameters that determine the strength of connections between neurons in different layers of a neural network. These weights are crucial for the model's ability to process and generate information. During the training phase, these weights are adjusted to optimize the model's performance, allowing it to learn and understand the relationships between different tokens. This process involves using a learning rate, which is a hyperparameter that controls the size of the steps taken to update the weights. Additionally, techniques like weight pruning can be used to simplify the model by removing weights that have minimal impact on the output. Regularization methods such as L1 and L2 are also employed to prevent overfitting by adding a penalty term to the loss function based on the magnitude of the weights. When [[Meta]] shares the "weights" of the [[LLaMA]] model, they are providing the parameters that have been learned during the training process, which include embedding, self-attention, feedforward, and bias weights.

= Risks = 
* [https://www.marktechpost.com/2023/07/07/how-risky-is-your-open-source-llm-project-a-new-research-explains-the-risk-factors-associated-with-open-source-llms/ How Risky Is Your Open-Source LLM Project? A New Research Explains The Risk Factors Associated With Open-Source LLMs | Anant Shahi - MarkTechPost]
* [https://venturebeat.com/datadecisionmakers/instead-of-ai-sentience-focus-on-the-current-risks-of-large-language-models Instead of AI sentience, focus on the current risks of large language models] 
* [https://www.deepmind.com/publications/ethical-and-social-risks-of-harm-from-language-models Ethical and social risks of harm from Language Models | DeepMind] 

Open-source LLMs (Large Language Models) are trained on massive amounts of data from the Internet, which makes them accessible and versatile, but also poses some risks. Some of the risk factors associated with open-source LLMs are:

* <b>Bias and toxicity</b>: LLMs can reflect and amplify the social biases and harmful language that exist in their training data, such as discrimination, exclusion, stereotypes, hate speech, etc. This can cause unfairness, offense, and harm to certain groups or individuals¹².
* <b>Privacy and security</b>: LLMs can leak or infer private or sensitive information from their training data or from user inputs, such as personal details, passwords, intellectual property, etc. This can compromise the confidentiality and integrity of the data and expose it to malicious actors¹².
* <b>Misinformation and manipulation</b>: LLMs can produce false or misleading information that can confuse or deceive users, such as inaccurate facts, bad advice, fake news, etc. This can affect the quality and trustworthiness of the information and influence the users' decisions and actions¹²³.
* <b>Malicious uses</b>: LLMs can be used by adversaries to cause harm or disruption, such as spreading disinformation, creating scams or frauds, generating malicious code or weapons, etc. This can threaten the security and stability of individuals, organizations, and society²⁴.
* <b>Human-computer interaction harms</b>: LLMs can affect the psychological and social well-being of users who interact with them, such as creating unrealistic expectations, reducing critical thinking, diminishing human agency, etc. This can impact the users' identity, autonomy, and relationships².

<hr>

Life or death isn’t an issue at Morgan Stanley, but producing highly accurate responses to financial and investing questions is important to the firm, its clients, and its regulators. The answers provided by the system were carefully evaluated by human reviewers before it was released to any users. Then it was piloted for several months by 300 financial advisors. As its primary approach to ongoing evaluation, Morgan Stanley has a set of 400 “golden questions” to which the correct answers are known. Every time any change is made to the system, employees test it with the golden questions to see if there has been any “regression,” or less accurate answers. - [https://hbr.org/2023/07/how-to-train-generative-ai-using-your-companys-data How to Train Generative AI Using Your Company’s Data | Tom Davenport & Maryam Alavi - Harvard Business Review]

<youtube>r4kButlDLUc</youtube>

= Multi-step Multi-model Approach =
The Multi-step Multi-model Approach with Large Language Models (LLMs) refers to the utilization of multiple LLMs in a sequential manner to tackle complex language processing tasks. As with any multi-model approach, there are considerations related to computational resources, deployment complexity, and potential challenges in combining the outputs effectively. However, when properly implemented, the Multi-step Multi-model Approach with LLMs can lead to significant improvements in various language-related applications.

In the context of the Multi-step Multi-model Approach with LLMs, the following steps are generally involved:

* <b>Problem Formulation</b>: Clearly define the language processing task you want to address. It could be natural language understanding (NLU), natural language generation (NLG), question-answering, sentiment analysis, language translation, or any other language-related challenge.

* <b>Model Selection</b>: Choose a set of diverse LLMs that are well-suited for the specific language processing tasks you want to address. Different LLMs might excel in different aspects of language understanding, so having a variety of models can be beneficial.

* <b>Model Pre-training</b>: Before fine-tuning the LLMs for your specific task, you need to pre-train them on a large corpus of text data. Pre-training helps the models learn the underlying patterns and structures in the language.

* <b>Fine-tuning</b>: After pre-training, the LLMs are fine-tuned on a task-specific dataset. Fine-tuning involves training the models on labeled data relevant to your target task. This process allows the models to adapt to the specific problem and make better predictions.

* <b>Ensemble Construction</b>: Once you have multiple LLMs that are fine-tuned for the target tasks, you can create an ensemble of these models. Ensemble methods combine the predictions of individual models to make the final decision. Techniques like averaging, voting, or more sophisticated approaches can be used to combine the outputs of the LLMs.

* <b>Sequential Application</b>: The ensemble of LLMs can be applied sequentially, where the output of one model becomes the input to the next model in the pipeline. Each LLM can focus on different aspects of the language processing task, contributing to the overall understanding and generation process.

* <b>Model Evaluation and Refinement</b>: Evaluate the performance of the multi-step multi-model approach using appropriate metrics and validation techniques. If necessary, fine-tuning or retraining of individual LLMs can be performed to optimize the overall system.

Benefits of the Multi-step Multi-model Approach with LLMs:

* Enhanced Language Understanding: By leveraging multiple LLMs, you can benefit from their diverse capabilities and obtain a more comprehensive understanding of the language context.
* Improved Generation Quality: When generating responses or text, the ensemble of LLMs can produce more coherent and contextually appropriate outputs.
* Flexibility and Adaptability: The approach can be adapted to a wide range of language processing tasks, making it a versatile solution.

= LM Studio: Discover, download, and run local LLMs =
* [https://lmstudio.ai/ LM Studio]

LM Studio is a desktop application that allows users to experiment with local and open-source Large Language Models (LLMs). It provides an easy-to-use platform for running LLMs locally on Mac, Windows, and potentially Linux. To download and install LM Studio, follow these steps:

1.Download LM Studio:
* Visit the LM Studio website at lmstudio.ai.
* Download the LM Studio desktop app for your specific platform (Mac or Windows)
* The download size is approximately 400MB, so it may take some time depending on your internet speed
 
2. Choose a Model:
* After launching LM Studio, select a model to download from the available options provided within the application
* Models like Zephyr-7B, Mixtral 8x7B, Google's Gemma model, and others are available for use
 
3. Run LLMs Locally:
* Once you have chosen and downloaded a model, you can start using it locally through LM Studio.
* You can converse with the LLM by selecting your model and enabling GPU acceleration if desired

System Requirements:
Ensure your system meets the requirements to run LM Studio effectively:
* Apple Silicon Mac with macOS 13.6 or newer.
* Windows/Linux PC with a processor supporting AVX2.
* Recommended RAM of 16GB+ and VRAM of 6GB+ for PCs.
* NVIDIA/AMD GPUs are supported

<youtube>yBI1nPep72Q</youtube>