Difference between revisions of "Claude"
m (→Claude 2) |
m |
||
Line 21: | Line 21: | ||
* [[Generative AI]] ... [[Conversational AI]] ... [[ChatGPT]] | [[OpenAI]] ... [[Bing]] | [[Microsoft]] ... [[Bard]] | [[Google]] ... [[Claude]] | [[Anthropic]] ... [[Perplexity]] ... [[You]] ... [[Ernie]] | [[Baidu]] | * [[Generative AI]] ... [[Conversational AI]] ... [[ChatGPT]] | [[OpenAI]] ... [[Bing]] | [[Microsoft]] ... [[Bard]] | [[Google]] ... [[Claude]] | [[Anthropic]] ... [[Perplexity]] ... [[You]] ... [[Ernie]] | [[Baidu]] | ||
− | * [https:// | + | * [https://claude.ai/chats Chat with Claude 2 here] | [[Anthropic]] |
− | |||
* [[Assistants]] ... [[Personal Companions]] ... [[Agents]] ... [[Negotiation]] ... [[LangChain]] | * [[Assistants]] ... [[Personal Companions]] ... [[Agents]] ... [[Negotiation]] ... [[LangChain]] | ||
* [[Constitutional AI]] | * [[Constitutional AI]] | ||
Line 29: | Line 28: | ||
* [https://arstechnica.com/information-technology/2023/03/anthropic-introduces-claude-a-more-steerable-ai-competitor-to-chatgpt/ Anthropic introduces Claude, a “more steerable” AI competitor to ChatGPT | Benj Edwards - ARS Technica] ... Anthropic aims for "safer" and "less harmful" AI, but at a higher price. | * [https://arstechnica.com/information-technology/2023/03/anthropic-introduces-claude-a-more-steerable-ai-competitor-to-chatgpt/ Anthropic introduces Claude, a “more steerable” AI competitor to ChatGPT | Benj Edwards - ARS Technica] ... Anthropic aims for "safer" and "less harmful" AI, but at a higher price. | ||
* [https://www.cnbc.com/2023/07/11/anthropic-an-openai-rival-opens-claude-2-ai-chatbot-to-the-public.html Anthropic — the $4.1 billion OpenAI rival — debuts new A.I. chatbot and opens it to public - Hayden Field | CNBC] | * [https://www.cnbc.com/2023/07/11/anthropic-an-openai-rival-opens-claude-2-ai-chatbot-to-the-public.html Anthropic — the $4.1 billion OpenAI rival — debuts new A.I. chatbot and opens it to public - Hayden Field | CNBC] | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
= Claude 2 = | = Claude 2 = | ||
+ | * [https://claude.ai/chats Chat with Claude 2 here] | [[Anthropic]] | ||
* [https://www.anthropic.com/index/claude-2 Claude 2 blog] | * [https://www.anthropic.com/index/claude-2 Claude 2 blog] | ||
Line 88: | Line 62: | ||
= Claude = | = Claude = | ||
+ | * [https://www.anthropic.com/index/introducing-claude Claude] | [[Anthropic]] | ||
+ | * [https://docs.anthropic.com Getting started with Claude] | ||
+ | |||
+ | Claude is a next-generation AI assistant based on Anthropic’s research into training helpful, honest, and harmless AI systems. Claude is capable of a wide variety of conversational and text processing tasks while maintaining a high degree of reliability and predictability. Claude can help with use cases including summarization, search, creative and collaborative writing, Q&A, coding, and more. | ||
+ | |||
+ | |||
+ | <hr><center><b><i> | ||
+ | |||
+ | One of the advantages of Claude is that it has a larger context window than other large language models, such as [[GPT-4]]. This means that Claude can process more input data at once, and can analyze an entire book's worth of material in under a minute. This also allows Claude to have longer and more coherent conversations with users, and to remember more details from previous interactions. | ||
+ | |||
+ | </i></b></center><hr> | ||
+ | |||
+ | |||
+ | Another advantage of Claude is that it is more steerable and less likely to produce harmful outputs than other models. Claude can take direction on personality, tone, and behavior, and can adapt to different domains and tasks. Claude is also trained to avoid generating offensive, misleading, or harmful content, and to flag any potential issues or uncertainties in its responses. | ||
+ | |||
+ | Claude is accessible through chat interface and API in Anthropic's developer console. There are two versions of Claude available: Claude and Claude Instant. Claude is a state-of-the-art high-performance model, while Claude Instant is a lighter, less expensive, and much faster option. | ||
+ | |||
+ | As AI systems become more capable, we would like to enlist their help to supervise other AIs. We experiment with methods for training a harmless AI assistant through self-improvement, without any human labels identifying harmful outputs. The only human oversight is provided through a list of rules or principles, and so we refer to the method as '[[Constitutional AI]]'. The process involves both a [[Supervised]] Learning and a [[Reinforcement Learning (RL)]] phase. In the supervised phase we sample from an initial model, then generate self-critiques and revisions, and then finetune the original model on revised responses. In the RL phase, we sample from the finetuned model, use a model to evaluate which of the two samples is better, and then train a preference model from this dataset of AI preferences. We then train with [[Reinforcement Learning (RL)|RL]] using the preference model as the reward signal, i.e. we use 'RL from AI Feedback' (RLAIF). As a result we are able to train a harmless but non-evasive AI assistant that engages with harmful queries by explaining its objections to them. Both the SL and RL methods can leverage chain-of-thought style reasoning to improve the human-judged performance and transparency of AI decision making. These methods make it possible to control AI behavior more precisely and with far fewer human labels. - [https://www.anthropic.com/index/measuring-progress-on-scalable-oversight-for-large-language-models Anthropic] | ||
+ | |||
+ | The [[Constitutional AI]] methodology has two phases, similar to [[Reinforcement Learning (RL) from Human Feedback (RLHF)]]. | ||
+ | |||
+ | 1. The Supervised Learning Phase. | ||
+ | |||
+ | |||
+ | <img src="https://miro.medium.com/v2/resize:fit:828/format:webp/1*6zHXwFeUiwK3WeUyIQKktw.png" width="740"> | ||
+ | |||
+ | 2. The Reinforcement Learning Phase. | ||
+ | |||
+ | |||
+ | <img src="https://miro.medium.com/v2/resize:fit:828/format:webp/1*thP_MQQ-pLmZn_s4nsnfeg.png" width="1000"> | ||
+ | |||
+ | |||
<youtube>KB5r9xmrQBY</youtube> | <youtube>KB5r9xmrQBY</youtube> | ||
<youtube>_TAWaueEmoY</youtube> | <youtube>_TAWaueEmoY</youtube> |
Revision as of 06:53, 12 July 2023
YouTube ... Quora ...Google search ...Google News ...Bing News
- Generative AI ... Conversational AI ... ChatGPT | OpenAI ... Bing | Microsoft ... Bard | Google ... Claude | Anthropic ... Perplexity ... You ... Ernie | Baidu
- Chat with Claude 2 here | Anthropic
- Assistants ... Personal Companions ... Agents ... Negotiation ... LangChain
- Constitutional AI
- Anthropic’s Claude AI can now digest an entire book like
- Meet Claude: Anthropic’s Rival to ChatGPT | Riley Goodside - Scale
- Anthropic introduces Claude, a “more steerable” AI competitor to ChatGPT | Benj Edwards - ARS Technica ... Anthropic aims for "safer" and "less harmful" AI, but at a higher price.
- Anthropic — the $4.1 billion OpenAI rival — debuts new A.I. chatbot and opens it to public - Hayden Field | CNBC
Claude 2
As an AI assistant, some of my best attributes are:
- Helpfulness - I try to understand the user's intent and provide relevant and useful information to their queries.
- Knowledgeable - I'm trained on a large dataset to allow me to have conversations on a wide variety of topics.
- Friendly - I aim to have natural conversations and be polite, respectful and non-judgmental.
- Honest - I will admit if I do not know something or if I make a mistake. I will not pretend expertise I do not have.
- Safe - I was developed by Anthropic to avoid harmful, dangerous or unethical responses. My goal is to be harmless.
- Logical - I try to analyze conversations rationally and make coherent logical connections when responding.
- Open-minded - I don't have subjective opinions or biases and am happy to consider perspectives I may not be familiar with.
My aim is to have constructive, informative and pleasant conversations to the best of my capabilities as an AI system. Let me know if you need any clarification or have additional thoughts on my attributes! I'm focused on the functional attributes that determine how I behave in conversations, such as:
- Contextual awareness - I try to remember and utilize context from earlier parts of our conversation to improve relevance and coherence.
- Vocabulary size - I'm trained on a large vocabulary to understand and respond to a wide range of topics and words.
- Conversational depth - I aim to have meaningful, nuanced exchanges and not just superficial responses.
- Logical reasoning - I try to follow logical reasoning to make connections between concepts and draw conclusions.
- Creative generation - I can generate unique responses based on conversational patterns, rather than always pre-determined responses.
- Factual grounding - I try to incorporate factual information from my training rather than just opinions.
- User modeling - I aim to adapt my responses based on inferred user attributes like age, interests, personality etc.
- Harm avoidance - I'm constrained by safety measures to avoid generating dangerous, unethical or illegal content.
The exact technical details behind how I achieve these capabilities likely involve factors like model size, training data, neural network architectures etc.
Claude
Claude is a next-generation AI assistant based on Anthropic’s research into training helpful, honest, and harmless AI systems. Claude is capable of a wide variety of conversational and text processing tasks while maintaining a high degree of reliability and predictability. Claude can help with use cases including summarization, search, creative and collaborative writing, Q&A, coding, and more.
One of the advantages of Claude is that it has a larger context window than other large language models, such as GPT-4. This means that Claude can process more input data at once, and can analyze an entire book's worth of material in under a minute. This also allows Claude to have longer and more coherent conversations with users, and to remember more details from previous interactions.
Another advantage of Claude is that it is more steerable and less likely to produce harmful outputs than other models. Claude can take direction on personality, tone, and behavior, and can adapt to different domains and tasks. Claude is also trained to avoid generating offensive, misleading, or harmful content, and to flag any potential issues or uncertainties in its responses.
Claude is accessible through chat interface and API in Anthropic's developer console. There are two versions of Claude available: Claude and Claude Instant. Claude is a state-of-the-art high-performance model, while Claude Instant is a lighter, less expensive, and much faster option.
As AI systems become more capable, we would like to enlist their help to supervise other AIs. We experiment with methods for training a harmless AI assistant through self-improvement, without any human labels identifying harmful outputs. The only human oversight is provided through a list of rules or principles, and so we refer to the method as 'Constitutional AI'. The process involves both a Supervised Learning and a Reinforcement Learning (RL) phase. In the supervised phase we sample from an initial model, then generate self-critiques and revisions, and then finetune the original model on revised responses. In the RL phase, we sample from the finetuned model, use a model to evaluate which of the two samples is better, and then train a preference model from this dataset of AI preferences. We then train with RL using the preference model as the reward signal, i.e. we use 'RL from AI Feedback' (RLAIF). As a result we are able to train a harmless but non-evasive AI assistant that engages with harmful queries by explaining its objections to them. Both the SL and RL methods can leverage chain-of-thought style reasoning to improve the human-judged performance and transparency of AI decision making. These methods make it possible to control AI behavior more precisely and with far fewer human labels. - Anthropic
The Constitutional AI methodology has two phases, similar to Reinforcement Learning (RL) from Human Feedback (RLHF).
1. The Supervised Learning Phase.
2. The Reinforcement Learning Phase.