References
- E. Altman, Constrained Markov decision processes, Chapman and Hall/CRC, Boca Raton, 1999.
- J. R. Baxter, R.V. Chacon, Compactness of stopping times, Z. Wahrscheinlichkeitstheorie verw. Gebiete 40(1977) 169–181. doi: 10.1007/BF00736045
- R. Cairoli, R. C. Dalang, Sequential stochastic optimization, John Wiley & Sons, New York, 1996.
- C. Castaing, M. Valadier, Convex analysis and measurable multifunctions, Springer-Verlag, Berlin, 1977.
- G. A. Edgar, A. Millet, L. Sucheston, On compactness and optimality of stopping times, in Martingale theory in harmonic analysis and Banach spaces, LNM 939 (1981) 36–61.
- A. G. Fakeev, On necessary conditions for optimality in sequential decision problems, Theory Probab. Appl. 14(1969) 710–713. doi: 10.1137/1114090
- M. Horiguchi, Markov decision processes with a stopping time constraint, Math.Meth. Oper.Res. 53(2001) 279–295. doi: 10.1007/PL00003996
- M. Horiguchi, Stopped Markov decision processes with multiple constraints, Math.Meth. Oper.Res. 54(2001) 455–469. doi: 10.1007/s001860100160
- D. P. Kennedy, On a constrained optimal stopping problem, J.Appl. Prob. 19(1982) 631–641. doi: 10.2307/3213520
- H–C. Lai, K. Tanaka, On continuous time discounted stochastic dynamic programming, Appl. Math. Optim. 23 (1991) 155–169. doi: 10.1007/BF01442395
- F. J. López, M. San Miguel, G. Sanz, Lagrangean methods and optimal stopping, Optimization 34(1995) 317–327. doi: 10.1080/02331939508844116
- D. G. Luenberger, Optimization by vector space methods, John Wiley & Sons, New York, 1969.
- C. Makasu, Bounds for a constrained optimal stopping problem, Optim.Lett. 3(2009) 499–505. doi: 10.1007/s11590-009-0127-8
- T. Maruyama, Integration and functional analysis, Springer-Verlag, Tokyo, 2006 (in Japanese).
- H. Morimoto, Optimal stopping and a martingale approach to the penalty method, Tohoku Math.Journ. 34(1982) 407–416. doi: 10.2748/tmj/1178229202
- D.C. Nachman, Optimal stopping with a horizon constraint, Math. Oper.Res. 51(1980) 26–134.
- A.B. Piunovskiy, Dynamic programming in constrained Markov decision processes, Control and Cybernetics, 35(2006) 645–660.
- K. Tanaka, On discounted dynamic programming with constrains, J. Math. Anal. Appl. 155(1991) 264–277. doi: 10.1016/0022-247X(91)90037-Z
- T. Tanaka, Discrete time multi-parameter optimal stopping problems with multiple plays and switching costs, J. Interdisciplinary Math. 6(2002) 253–264. doi: 10.1080/09720502.2003.10700344
- T. Tanaka, The accessibility and multiple filtration structure for discrete time multiparameter optimal multiple stopping problem, J. Statistics Management Systems 7(2004) 221–235. doi: 10.1080/09720510.2004.10701117
- T. Tanaka, Randomized and non–randomized continuous time optimal stopping problems with constraints, Preprint 2016.
- T. Tanaka, Fakeev’s necessary conditions for optimality in multi– parameter optimal stopping problems, Preprint 2016.
- J. Yong, X. Y. Zhou, Stochastic controls, Springer-Verlag, New York, 1999.