References
- Bank , P. and El Karoui , N. 2004 . A stochastic representation theorem with applications to optimization and obstacle problems . Ann. Probab. , 32 ( 1B ) : 1030 – 1067 .
- Boyarchenko , S. and Levendorski , S. 2007 . Irreversible Decisions Under Uncertainty: Optimal Stopping Made Easy , Berlin : Springer .
- Denardo , E. , Rothblum , U. and Van der Heyden , L. 2004 . Index policies for stochastic search in a forest with an application to R&D project management . Math. Oper. Res. , 29 ( 1 ) : 162 – 181 .
- Feinberg , E. and Shwartz , A. 2002 . Handbook of Markov Decision Processes , International Series in Operations Research & Management Science Vol. 40 , Boston, MA : Kluwer Academic Publishers .
- Gittins , J.C. 1979 . Bandit processes and dynamic allocation indices . J. Roy. Statist. Soc. Ser. B , 41 ( 2 ) : 148 – 177 .
- Granot , D. and Zuckerman , D. 1991 . Optimal sequencing and resource allocation in research and development projects . Manag. Sci. , 37 : 140 – 156 .
- Katehakis , M. and Veinott , A. 1987 . The multi-armed bandit problem: Decomposition and computation . Math. Oper. Res. , 12 ( 2 ) : 262 – 268 .
- Mitten , L. 1960 . An analytic solution to the least cost testing sequence problem . J. Ind. Eng. , 11 ( 1 ) : 17
- Presman , E. and Sonin , I. 2006 . “ A Gittins type index theorem for randomly evolving graphs ” . In From Stochastic Calculus to Mathematical Finance. The Shiryaev Festschrift , XXXVIII Edited by: Kabanov , Y. , Lipster , R. and Stoyanov , J. 567 – 588 . Berlin : Springer .
- I. Sonin, Two simple theorems in the problems of optimal stopping, in Proceedings Informs Appl. Prob. Conf., Atlanta, GA, 1995
- Sonin , I. 1999 . The elimination algorithm for the problem of optimal stopping . Math. Meth. Oper. Res. , 49 ( 1 ) : 111 – 123 .
- Sonin , I. 1999 . The state reduction and related algorithms and their applications to the study of Markov chains, graph theory and the optimal stopping problem . Adv. Math. , 145 : 159 – 188 .
- Sonin , I. 2008 . A generalized Gittins index for a Markov chain and its recursive calculation . Statist. Probab. Lett. , 78 ( 12,1 ) : 1526 – 1533 .
- I. Sonin and S. Steinberg, Continue, quit, restart probability models, manuscript, 2010
- Varaiya , P. , Walrand , J. and Buyukkoc , C. 1984 . Extensions of the multiarmed bandit problem: The discounted case . IEEE Trans. Automat. Control , AC-30 : 26 – 439 .
- Whittle , P. 1980 . Multi-armed bandits and the Gittins index . J. Roy. Statist. Soc. Ser. B , 42 ( 2 ) : 143 – 149 .
![Supercharge Your Next Research Paper: Research and write your next paper with Jenni AI.]({"type":"image" , "src" : "/sda/112445/Skyscraper-econ.png"})