Publication Cover
Stochastics
An International Journal of Probability and Stochastic Processes
Volume 83, 2011 - Issue 4-6: Optimal stopping with Applications
159
Views
4
CrossRef citations to date
0
Altmetric
Original Articles

A new approach to the solution of optimal stopping problem in a discrete time

Pages 467-475 | Received 01 Dec 2009, Accepted 01 Sep 2010, Published online: 09 Jun 2011
 

Abstract

An optimal stopping problem of Markov chain with infinite horizon is considered. For the case of finite number m of states, Sonin proposed an algorithm, which allows to find the value function and the stopping set in not more than steps. The algorithm is based on a modification of Markov chain on each step, related with the elimination of the states which certainly belong to the continuation set. To solve the problem with arbitrary state space and to have a possibility of generalization to the continuous time, one needs to modify the procedure. We propose a procedure which is based on a sequential modification of the pay-off function for the same chain in such a way, that the value function is the same for both problems and the modified pay-off function is greater than the initial one on some set and is equal to it on the complement. We show the efficiency of this procedure.

AMS Subject Classification::

Acknowledgements

The author would like to thank V.I. Arkin and A.D. Slastnikov for useful discussions, and I.M. Sonin, Yu.M. Kabanov, two referees, and AE for their very valuable remarks and suggestions. This work was partly supported by RFBR grant no. 10-01-00767-a.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 1,425.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.