Reinforcement Learning (RL)

YouTube ... Quora ...Google search ...Google News ...Bing News

• Artificial Intelligence (AI) ... Generative AI ... Machine Learning (ML) ... Deep Learning ... Neural Network ... Reinforcement ... Learning Techniques
• Reinforcement Learning - Games, Self-driving Vehicles, Drones, Robotics, Management, Finance
• Agents ... Robotic Process Automation ... Assistants ... Personal Companions ... Productivity ... Email ... Negotiation ... LangChain
• Inverse Reinforcement Learning (IRL)
• Gaming ... Game-Based Learning (GBL) ... Security ... Generative AI ... Games -Metaverse ... Quantum ... Game Theory
  • Minecraft: Voyager ... an AI agent powered by a Large Language Model (LLM) that has been introduced to the world of Minecraft
• Policy ... Policy vs Plan ... Constitutional AI ... Trust Region Policy Optimization (TRPO) ... Policy Gradient (PG) ... Proximal Policy Optimization (PPO)
• Robotics ... Vehicles ... Drones ... 3D Model ... 3D Simulation Environments ... Simulated Environment Learning ... Point Cloud
• Multi-Task Learning (MTL) ... SMART - Multi-Task Deep Neural Networks (MT-DNN)
• AdaNet
• Feedback Loop - The AI Economist
• Dopamine Google DeepMind
• Math for Intelligence ... Finding Paul Revere ... Social Network Analysis (SNA) ... Dot Product ... Kernel Trick
• Artificial General Intelligence (AGI) to Singularity ... Curious Reasoning ... Emergence ... Moonshots ... Explainable AI ... Automated Learning
• World Models
• Google DeepMind AlphaGo Zero
• Neural Architecture Search (NAS) with Reinforcement Learning | Barret Zoph & Quoc V. Le ...Wikipedia
• Beyond DQN/A3C: A Survey in Advanced Reinforcement Learning | Joyce Xu - Towards Data Science
• Google’s AI picks which machine learning models will produce the best results | Kyle Wiggers - VentureBeat off-policy classification,” or OPC, which evaluates the performance of AI-driven agents by treating evaluation as a classification problem
• Deep Reinforcement Learning Hands-On: Apply modern RL methods, with deep Q-networks, value iteration, policy gradients, TRPO, AlphaGo Zero and more | Maxim Lapan
• Reinforcement-Learning-Notebooks - A collection of Reinforcement Learning algorithms from Sutton and Barto's book and other research papers implemented in Python
• What is Reinforcement Learning? | Daniel Nelson - Unite.ai
• Reinforcement Learning (RL) | Wikipedia
• A Beginner's Guide to Deep Reinforcement Learning | Chris Nicholson - A.I. Wiki pathmind
• Use subject matter expertise in machine teaching and reinforcement learning | Microsoft
• Faster sorting algorithms discovered using deep reinforcement learning | D. Mankowitz, A. Michi, A. Zhernov, M. Gelmi, M. Selvi, C. Paduraru, E. Leurent, S. Iqbal, J. Lespiau, A. Ahern, T. Köppe, K. Millikin, S. Gaffney, S. Elster, J. Broshear, C. Gamble, K. Milan, R. Tung, M. Hwang, T. Cemgil, M. Barekatain, Y. Li, A. Mandhane, T. Hubert, D. Silver - Nature ... Deep reinforcement learning has been used to improve computer code by treating the task as a game — with no special knowledge needed on the part of the player. The result has already worked its way into countless programs.
• Develop Your First AI Agent: Deep Q-Learning | Heston Vaughan - Towards Data Science

Reinforcement Learning (RL) A technique that teaches an AI model to find the best result through trial and error and receiving rewards or punishments based on its results, often enhanced by human feedback for games and complex tasks.

---

DeepMind says reinforcement learning is enough to reach Artificial General Intelligence (AGI)
... Some scientists believe that assembling multiple narrow AI modules will produce higher intelligent systems.

---

How does it work?

This is a bit similar to the traditional type of data analysis; the algorithm discovers through trial and error and decides which action results in greater rewards. Three major components can be identified in reinforcement learning functionality: the agent, the environment, and the actions. The agent is the learner or decision-maker, the environment includes everything that the agent interacts with, and the actions are what the agent can do. Reinforcement learning occurs when the agent chooses actions that maximize the expected reward over a given time. This is best achieved when the agent has a good policy to follow. Machine Learning: What it is and Why it Matters | Priyadharshini @ simplilearn

Control-based: When running a Reinforcement Learning (RL) policy in the real world, such as controlling a physical robot on visual inputs, it is non-trivial to properly track states, obtain reward signals or determine whether a goal is achieved for real. The visual data has a lot of noise that is irrelevant to the true state and thus the equivalence of states cannot be inferred from pixel-level comparison. Self-supervised representation learning has shown great potential in learning useful state embedding that can be used directly as input to a control policy.

Reinforcement Learning (RL) Algorithms

• Reinforcement Learning (RL) from Human Feedback (RLHF)
  • ChatGPT
• In-context Reinforcement Learning
• Monte Carlo (MC) Method - Model Free Reinforcement Learning
• Markov Decision Process (MDP)
• State-Action-Reward-State-Action (SARSA)
• Q Learning
  • Deep Q Network (DQN)
• Deep Reinforcement Learning (DRL) DeepRL
• Distributed Deep Reinforcement Learning (DDRL)
• Evolutionary Computation / Genetic Algorithms
• Actor Critic
  • Asynchronous Advantage Actor Critic (A3C)
  • Advanced Actor Critic (A2C)
  • Lifelong Latent Actor-Critic (LILAC)
• Hierarchical Reinforcement Learning (HRL)
• Apprenticeship Learning - Inverse Reinforcement Learning (IRL)
• Lifelong Learning

Q Learning Algorithm and Agent - Reinforcement Learning w/ Python Tutorial | Sentdex - Harrison

P.1

P.2

P.3

P.4

P.5

P.6

Reinforcement Learning | Phil Tabor

• Code | GitHub

Reinforcement learning is an area of machine learning that involves taking right action to maximize reward in a particular situation. In this full tutorial course, you will get a solid foundation in reinforcement learning core topics. The course covers Q learning, State-Action-Reward-State-Action (SARSA), double Q learning, Deep Q Learning (DQN), and Policy Gradient (PG) methods. These algorithms are employed in a number of environments from the open AI gym, including space invaders, breakout, and others. The deep learning portion uses Tensorflow and PyTorch. The course begins with more modern algorithms, such as deep q learning and Policy Gradient (PG) methods, and demonstrates the power of reinforcement learning. Then the course teaches some of the fundamental concepts that power all reinforcement learning algorithms. These are illustrated by coding up some algorithms that predate deep learning, but are still foundational to the cutting edge. These are studied in some of the more traditional environments from the OpenAI Gym, like the cart pole problem.

⌨️ (00:00:00) Introduction

⌨️ (00:01:30) Intro to Deep Q Learning

⌨️ (00:08:56) How to Code Deep Q Learning in Tensorflow

⌨️ (00:52:03) Deep Q Learning with Pytorch Part 1: The Q Network

⌨️ (01:06:21) Deep Q Learning with Pytorch part 2: Coding the Agent

⌨️ (01:28:54) Deep Q Learning with Pytorch part 3

⌨️ (01:46:39) Intro to Policy Gradients 3: Coding the main loop

⌨️ (01:55:01) How to Beat Lunar Lander with Policy Gradients

⌨️ (02:21:32) How to Beat Space Invaders with Policy Gradients

⌨️ (02:34:41) How to Create Your Own Reinforcement Learning Environment Part 1

⌨️ (02:55:39) How to Create Your Own Reinforcement Learning Environment Part 2

⌨️ (03:08:20) Fundamentals of Reinforcement Learning

⌨️ (03:17:09) Markov Decision Processes

⌨️ (03:23:02) The Explore Exploit Dilemma

⌨️ (03:29:19) Reinforcement Learning in the Open AI Gym: SARSA

⌨️ (03:39:56) Reinforcement Learning in the Open AI Gym: Double Q Learning

⌨️ (03:54:07) Conclusion

Gridworld: How To Create Your Own Reinforcement Learning Environments

• Designing Your Own Open Ai Gym Compatible Reinforcement Learning Environment | NEURALNET.AI

Reinforcement Learning (RL) from Human Feedback (RLHF)

• ChatGPT
• Illustrating Reinforcement Learning from Human Feedback (RLHF) | N. Lambert, L. Castricato, L. von Werra, and A. Havrilla - Hugging Face