We have a new preprint on partially observable Markov decision processes (POMDP)