3 Marthi, B. Russell, S.J Andre, D. 2006 A compact, hierarchical, Q-function decomposition Proceedings of the 22nd Conference on Uncertainty in Artificial Intelligence.