Difference between revisions of "Proximal Policy Optimization (PPO)"
m |
m |
||
| Line 34: | Line 34: | ||
** [[Bidirectional Encoder Representations from Transformers (BERT)]] ... a better model, but less investment than the larger [[OpenAI]] organization | ** [[Bidirectional Encoder Representations from Transformers (BERT)]] ... a better model, but less investment than the larger [[OpenAI]] organization | ||
** [[ChatGPT]] | [[OpenAI]]: | ** [[ChatGPT]] | [[OpenAI]]: | ||
| − | *** [[ | + | *** [[Attention]] Mechanism ...[[Transformer]] Model ...[[Generative Pre-trained Transformer (GPT)]] |
| − | |||
*** [[Reinforcement Learning (RL) from Human Feedback (RLHF)]] | *** [[Reinforcement Learning (RL) from Human Feedback (RLHF)]] | ||
*** [[Supervised]] Learning | *** [[Supervised]] Learning | ||
Revision as of 11:13, 19 March 2023
Youtube search... ...Google search
- Proximal policy optimization algorithms | J. Schulman, F. Wolski, P. Dhariwal, A. Radford & O. Klimov 2017
- Deep Reinforcement Learning (DRL)
- Policy Gradient (PG)
- Reinforcement Learning (RL):
- Monte Carlo (MC) Method - Model Free Reinforcement Learning
- Markov Decision Process (MDP)
- Q Learning
- State-Action-Reward-State-Action (SARSA)
- Deep Reinforcement Learning (DRL) DeepRL
- Distributed Deep Reinforcement Learning (DDRL)
- Deep Q Network (DQN)
- Evolutionary Computation / Genetic Algorithms
- Actor Critic
- Hierarchical Reinforcement Learning (HRL)
- Assistants ... Hybrid Assistants ... Agents ... Negotiation
- Natural Language Processing (NLP) ...Generation ...LLM ...Tools & Services
- Generative AI ... OpenAI's ChatGPT ... Perplexity ... Microsoft's BingAI ... You ...Google's Bard
- ChatGPT is everywhere. Here’s where it came from | Will Douglas Heaven - MIT Technology Review
- Sequence to Sequence (Seq2Seq)
- Recurrent Neural Network (RNN)
- Long Short-Term Memory (LSTM)
- Bidirectional Encoder Representations from Transformers (BERT) ... a better model, but less investment than the larger OpenAI organization
- ChatGPT | OpenAI:
