Difference between revisions of "Markov Decision Process (MDP)"

From
Jump to: navigation, search
Line 11: Line 11:
 
* [[Reinforcement Learning (RL)]]
 
* [[Reinforcement Learning (RL)]]
 
** [[Monte Carlo]] (MC) Method - Model Free Reinforcement Learning
 
** [[Monte Carlo]] (MC) Method - Model Free Reinforcement Learning
 +
** Markov Decision Process (MDP)
 
** [[Q Learning]]
 
** [[Q Learning]]
 
** [[State-Action-Reward-State-Action (SARSA)]]
 
** [[State-Action-Reward-State-Action (SARSA)]]

Revision as of 11:44, 3 July 2020

Youtube search... ...Google search


600px-Markov_Decision_Process.svg.png big_thumb.jpg

Solutions:

Used where outcomes are partly random and partly under the control of a decision maker. MDP is a discrete time stochastic control process. At each time step, the process is in some state s, and the decision maker may choose any action a that is available in state s. The process responds at the next time step by randomly moving into a new state s', and giving the decision maker a corresponding reward R_{a}(s,s')} R_a(s,s'). The probability that the process moves into its new state s' is influenced by the chosen action. Helping the convergence of certain algorithms a discount rate (factor) makes an infinite sum finite.