Difference between revisions of "LLaMA"

From
Jump to: navigation, search
m
m
Line 12: Line 12:
 
*** [https://ai.facebook.com/tools/ Tools for Advancing the World's AI]
 
*** [https://ai.facebook.com/tools/ Tools for Advancing the World's AI]
 
* [[Large Language Model (LLM)]]
 
* [[Large Language Model (LLM)]]
 +
* [[Alpaca]]
 
* [[Toolformer]]
 
* [[Toolformer]]
 
* [[Generative AI]]  ... [[Conversational AI]] ... [[OpenAI]]'s [[ChatGPT]] ... [[Perplexity]]  ... [[Microsoft]]'s [[Bing]] ... [[You]] ...[[Google]]'s [[Bard]] ... [[Baidu]]'s [[Ernie]]
 
* [[Generative AI]]  ... [[Conversational AI]] ... [[OpenAI]]'s [[ChatGPT]] ... [[Perplexity]]  ... [[Microsoft]]'s [[Bing]] ... [[You]] ...[[Google]]'s [[Bard]] ... [[Baidu]]'s [[Ernie]]

Revision as of 23:12, 22 April 2023

YouTube search... ...Google search


LLaMA is a Large Language Model (LLM) released by Meta Platforms Inc. (formerly Facebook Inc.) on February 24, 20231. Meta says it is democratizing access to LLMs, which are seen as one of the most important and beneficial forms of AI. The four foundation models of LLaMA are LLaMA-7B, LLaMA-13B, LLaMA-33B, and LLaMA-65B12. They have 7 billion, 13 billion, 33 billion, and 65 billion parameters respectively. The models are all based on the transformer architecture and trained on publicly available datasets. LLaMA-13B is remarkable because it can run on a single GPU and outperform GPT-3 (175 billion parameters) on most common sense reasoning benchmarks. LLaMA-65B is competitive with the best models from other AI labs, such as Chinchilla 70B and PaLM 540B.