Search Swinburne Research Bank
Please use this identifier to cite or link to this item: http://hdl.handle.net/1959.3/32773
 Download PDF (27 pages) (Adobe Acrobat PDF, -1 bytes) |
- Title
- A simple guide to partial observability
- Author(s)
- Mitchell, Matthew
- Abstract
- This guide provides an introduction to hidden Markov Models and draws heavily from the excellent tutorial paper written by Rabiner (1989). I have attempted to provide intuition into the various algorithms by using some simple fully worked examples to hopefully illuminate the mathematical descriptions provided by Rabiner. It is hoped the explanation of the concepts is sufficient to help an otherwise uninformed reader to understand later descriptions (such as Baum-Welch algorithm) where worked examples are not provided. The second part of this guide aims to explain the relationship between Hidden Markov Models (HMMs) and Partially Observable Decision Problems (POMDPs). While the primary concern in HMMs is to learn a good model, the addition of actions - the ability to make decisions - in POMDPs adds the additional concern of learning which action to select. These two problems are related to POMDPs which add the ability to learn a model and the ability to learn which action to select. Some systems address one of these concerns exclusively, others attempt to address both simultaneously. [Introduction]
- Publication type
- Technical report
- Research centre
- Swinburne University of Technology. Faculty of Higher Education, Lilydale
- Publication year
- 2008
- Keyword(s)
- Discrete Markov Chains; Hidden Markov Models; POMDPs
- Copyright
- Copyright © 2008 Matthew Mitchell.
- Full text
