Difference between revisions of "LLaMA"
m (→LLaMA 2) |
m (→LLaMA 2) |
||
| Line 35: | Line 35: | ||
* [https://about.fb.com/news/2023/07/llama-2/ Meta and Microsoft Introduce the Next Generation of Llama | Meta] | * [https://about.fb.com/news/2023/07/llama-2/ Meta and Microsoft Introduce the Next Generation of Llama | Meta] | ||
Meta released LLaMA in July 2023. The company said that it hopes that by making LLaMA 2 open-source, it will be able to improve the model by getting feedback from the wider community of developers. Microsoft and Meta are expanding their longstanding partnership, with Microsoft as the preferred partner for Llama 2. LLaMA is still under development, but it has already been used to create some impressive chatbots. For example, one chatbot called Allie can be used to provide customer support. Another chatbot called Galactica is designed for scientific research. LLaMA-2-7B, LLaMA-2-13B, and LLaMA-2-70B. | Meta released LLaMA in July 2023. The company said that it hopes that by making LLaMA 2 open-source, it will be able to improve the model by getting feedback from the wider community of developers. Microsoft and Meta are expanding their longstanding partnership, with Microsoft as the preferred partner for Llama 2. LLaMA is still under development, but it has already been used to create some impressive chatbots. For example, one chatbot called Allie can be used to provide customer support. Another chatbot called Galactica is designed for scientific research. LLaMA-2-7B, LLaMA-2-13B, and LLaMA-2-70B. | ||
| + | |||
<youtube>zJBpRn2zTco</youtube> | <youtube>zJBpRn2zTco</youtube> | ||
Revision as of 21:23, 21 July 2023
YouTube search... ...Google search
- Facebook AI
- Large Language Model (LLM)
- Alpaca
- Toolformer
- Generative AI ... Conversational AI ... ChatGPT | OpenAI ... Bing | Microsoft ... Bard | Google ... Claude | Anthropic ... Perplexity ... You ... Ernie | Baidu
- Assistants ... Personal Companions ... Agents ... Negotiation ... LangChain
- Meta unveils a new large language model that can run on a single GPU | Benj Edwards - Ars Technica ... LLaMA-13B reportedly outperforms ChatGPT-like tech despite being 10x smaller.
- Meta heats up Big Tech's AI arms race with new language model | Yuvraj Malik and Katie Paul - Reuters
- You can now run a GPT-3 level AI model on your laptop, phone, and Raspberry Pi | Benj Edwards - Ars Technica ... On Friday, a software developer named Georgi Gerganov created a tool called "llama.cpp" that can run Meta's new GPT-3-class AI large language model, LLaMA, locally on a Mac laptop. Soon thereafter, people worked out how to run LLaMA on Windows as well. Then someone showed it running on a Pixel 6 phone, and next came a Raspberry Pi (albeit running very slowly).
LLaMA is a Large Language Model (LLM) released by Meta Platforms Inc. (formerly Facebook Inc.).
LLaMA 2
Meta released LLaMA in July 2023. The company said that it hopes that by making LLaMA 2 open-source, it will be able to improve the model by getting feedback from the wider community of developers. Microsoft and Meta are expanding their longstanding partnership, with Microsoft as the preferred partner for Llama 2. LLaMA is still under development, but it has already been used to create some impressive chatbots. For example, one chatbot called Allie can be used to provide customer support. Another chatbot called Galactica is designed for scientific research. LLaMA-2-7B, LLaMA-2-13B, and LLaMA-2-70B.
LLaMA (initial)
LLaMA on February 24, 20231. Meta says it is democratizing access to LLMs, which are seen as one of the most important and beneficial forms of AI. The four foundation models of LLaMA are LLaMA-7B, LLaMA-13B, LLaMA-33B, and LLaMA-65B12. They have 7 billion, 13 billion, 33 billion, and 65 billion parameters respectively. The models are all based on the transformer architecture and trained on publicly available datasets. LLaMA-13B is remarkable because it can run on a single GPU and outperform GPT-3 (175 billion parameters) on most common sense reasoning benchmarks. LLaMA-65B is competitive with the best models from other AI labs, such as Chinchilla 70B and PaLM 540B.
