# Markov Model (Chain, Discrete Time, Continuous Time, Hidden)

YouTube search... ...Google search

Wikipedia says, "A hidden Markov model (HMM) is a statistical Markov model in which the system being modeled is assumed to be a Markov process with unobserved (hidden) states." What does that even mean? Introducing Hidden Markov Models (HMM) | Linear Digressions

Predecessor to Boltzmann machines (BM) and Hopfield network (HN). They can be understood as follows: from this node where I am now, what are the odds of me going to any of my neighbouring nodes? They are memoryless (i.e. Markov Property) which means that every state you end up in depends completely on the previous state. While not really a neural network, they do resemble neural networks and form the theoretical basis for BMs and HNs. MC aren’t always considered neural networks, as goes for BMs, RBMs and HNs. Markov chains aren’t always fully connected either. Hayes, Brian. “First links in the Markov chain.” American Scientist 101.2 (2013): 252.

## Contents

### Markov Chain (MC)

YouTube search... ...Google search

### Discrete Time Markov Chain (DTMC)

YouTube search... ...Google search

### Continuous Time Markov Chain (CTMC)

YouTube search... ...Google search

### Hidden Markov Model (HMM)

YouTube search... ...Google search

- Part-of-Speech (POS) Tagging
- Phylogenetic Hidden Markov Models | Adam Siepel and David Haussler
- Hidden Markov Models in Bioinformatics | V. De Fonzo, F. Aluffi-Pentini, and V. Parisi

### Viterbi Algorithm

YouTube search... ...Google search