Finite Horizon Decision Timing with Partially Observable Poisson Processes

REFERENCES

• Arjas , E. ; Haara , P. ; Norros , I. Filtering the histories of a partially observed marked point process . Stochastic Processes and their Applications 1992 , 40 ( 2 ), 225 – 250 .
   Web of Science ®Google Scholar
• Bather , J.A. An optimal stopping problem with costly information . Bulletin of Institute for International Statistics 1973 , 45 , 9 – 24 .
   Google Scholar
• Bayraktar , E. ; Sezer , S. Online change detection for a Poisson process with a phase-type change-time prior distribution . Sequential Analysis 2009 , 28 ( 2 ), 218 – 250 .
   Google Scholar
• Bayraktar , E. ; Dayanik , S. ; Karatzas , I. Adaptive Poisson disorder problem . Annals of Applied Probability 2006 , 16 ( 3 ), 1190 – 1261 .
   Web of Science ®Google Scholar
• Bensoussan , A. Stochastic Control of Partially Observable Systems ; Cambridge University Press : Cambridge , 1992 .
   Google Scholar
• Bertsekas , D.P. Dynamic Programming and Stochastic Control . Academic Press : New York , 1976 . Mathematics in Science and Engineering , 125 .
   Google Scholar
• Bremaud , P. Point Processes and Queues ; Springer : New York , 1981 .
   Google Scholar
• Cappé , O. ; Moulines , E. ; Ryden , T. Inference in Hidden Markov Models . Springer Series in Statistics : New York , 2005 .
   Google Scholar
• Costa , O.L.V. ; Davis , M.H.A. Approximations for optimal stopping of a piecewise-deterministic process . Mathematics of Control, Signals, and Systems 1988 , 1 ( 2 ), 123 – 146 .
   Google Scholar
• Cox , D. ; Isham , V. Point Processes ; Chapman and Hall : London , 1980 .
   Google Scholar
• Darroch , J.N. ; Morris , K.W. Passage-time generating functions for continuous-time finite Markov chains . Journal of Applied Probability 1968 , 5 ( 2 ), 414 – 426 .
   Web of Science ®Google Scholar
• Davis , M.H.A. Markov Models and Optimization ; Chapman & Hall : London , 1993 .
   Google Scholar
• Dayanik , S. ; Goulding , C. Detection and identification of an unobservable change in the distribution of a Markov-modulated random sequence . IEEE Transactions on Information Theory 2009 , 55 ( 7 ), 3323 – 3345 .
   Web of Science ®Google Scholar
• Dayanik , S. ; Sezer , S. Compound Poisson disorder problem . Mathematics of Operations Research 2005 , 31 ( 4 ), 649 – 672 .
   Web of Science ®Google Scholar
• Dayanik , S. ; Poor , V. ; Sezer , S. Sequential multi-hypothetis testing for (compound) Poisson processes . Stochastics 2008 , 80 ( 1 ), 19 – 50 .
   Google Scholar
• Dayanik , S. ; Poor , V. ; Sezer , S. Multisource Bayesian sequential change detection . Annals of Applied Probability 2008 , 18 ( 2 ), 552 – 590 .
   Web of Science ®Google Scholar
• Décamps , J.-P. ; Mariotti , T. ; Villeneuve , S. Investment timing under incomplete information . Mathematics of Operations Research 2005 , 30 , 472 – 500 .
   Web of Science ®Google Scholar
• Elliott , R.J. ; Malcolm , W.P. General smoothing formulas for Markov-modulated Poisson observations. Institute of Electrical and Electronics Engineers . Transactions on Automatic Control 2005 , 50 ( 8 ), 1123 – 1134 .
   Web of Science ®Google Scholar
• Elliott , R.J. ; Aggoun , L. ; Moore , J.B. Hidden Markov Models ; Volume 29 of Applications of Mathematics: Springer-Verlag : New York , 1995 .
   Google Scholar
• Fuh , C. SPRT and CUSUM in hidden Markov models . Annals of Statistics 2003 , 31 ( 3 ), 942 – 977 .
   Web of Science ®Google Scholar
• Gapeev , P. ; Peskir , G. The Wiener sequential testing problem with finite horizon . Stochastics and Stochastics Reports 2004 , 76 ( 1 ), 59 – 75 .
   Google Scholar
• Gapeev , P.V. Problems of sequential discrimination of hypotheses for a compound Poisson process with exponential jumps . Upsekhi Mat. Nauk 2002 , 57 ( 6(348) ), 171 – 172 .
   Google Scholar
• Grandell , J. Doubly Stochastic Poisson Processes . Springer-Verlag : Berlin , 1976 .
   Google Scholar
• Gugerli , U.S. Optimal stopping of a piecewise-deterministic Markov process . Stochastics 1986 , 19 ( 4 ), 221 – 236 .
   Google Scholar
• Jensen , R. Adoption and diffusion of an innovation of uncertain profitability . Journal of Economic Theory 1982 , 27 ( 1 ), 182 – 193 .
   Web of Science ®Google Scholar
• Jensen , U. Monotone stopping rules for stochastic processes in a semimartingale representation with applications. Optimization 1989, 20, 837–852.
   Google Scholar
• Jensen , U. An optimal stopping problem in risk theory . Scandinavian Actuarial Journal 1997 , 2 , 149 – 159 .
   Google Scholar
• Jensen , U. ; Hsu , G.-H. Optimal stopping by means of point process observations with applications in reliability . Mathematics of Operations Research 1993 , 18 ( 3 ), 645 – 657 .
   Web of Science ®Google Scholar
• Karlin , S. ; Taylor , H. An Introdution to Stochastic Modelling, , 3rd Ed.; Academic Press , 1998 .
   Google Scholar
• Lenhart , S. ; Liao , Y.C. Integro-differential equations associated with optimal stopping time of a piecewise-deterministic process . Stochastics 1985 , 15 ( 3 ), 183 – 207 .
   Google Scholar
• Liptser , R.S. ; Shiryaev , A.N. Statistics of Random Processes, I and II ; Springer-Verlag : Berlin , 2001 .
   Google Scholar
• Ludkovski , M. ; Sezer , S. Finite horizon decision timing with partially observable poisson processes. Technical report, University of Michigan, 2007. Available at http://arxiv.org/abs/ 1105.1484
   Google Scholar
• Makis , V. ; Jiang , X. Optimal replacement under partial observations . Mathematics of Operations Research 2003 , 28 ( 2 ), 382 – 394 .
   Web of Science ®Google Scholar
• Mamon , R.S. ; Elliott , R. Hidden Markov Models in Finance ; (International Series in Operations Research & Management Science). Springer : New York , 2007 .
   Google Scholar
• Mazziotto , G. Approximations of the optimal stopping problem in partial observation . Journal of Applied Probability 1986 , 23 ( 2 ), 341 – 354 .
   Web of Science ®Google Scholar
• McCardle , K.F. Information acquisition and the adoption of new technology . Management Science 1985 , 31 ( 11 ), 1372 – 1389 .
   Web of Science ®Google Scholar
• Monahan , G.E. Optimal stopping in a partially observable . Markov process with costly information. 1980 , 28 ( 6 ), 1319 – 1334 .
   Google Scholar
• Monahan , G.E. A survey of partially observable Markov decision processes: theory, models and algotihms . Management Science. 1982 , 28 , 1 – 16 .
   Web of Science ®Google Scholar
• Peskir , G. ; Shiryaev , A.N. Sequential testing problems for Poisson processes . Annals of Statistics 2000 , 28 , 837 – 859 .
   Web of Science ®Google Scholar
• Schöttl , A. Optimal stopping of a risk reserve process with interest and cost rates . Journal of Applied Probability 1998 , 35 ( 1 ), 115 – 123 .
   Web of Science ®Google Scholar
• Shiryaev , A.N. Optimal Stopping Rules ; Springer-Verlag : Berlin , 1978 .
   Google Scholar
• Smallwood , R. ; Sondik , E. The optimal control of partially observable Markov processes over a finite horizon . Operations Research 1973 , 21 , 1071 – 1088 .
   Web of Science ®Google Scholar
• Stadje , W. Maximal wearing-out of a deteriorating system: An optimal stopping approach . European Journal of Operational Research 1994 , 73 , 472 – 479 .
   Web of Science ®Google Scholar
• Stadje , W. An optimal stopping problem with two levels of incomplete information . Mathematical Methods of Operations Research 1997 , 45 , 119 – 131 .
   Web of Science ®Google Scholar
• Ulu , C. ; Smith , J.E. Uncertainty, information acquisition, and technology adoption . Operations Research 2009 , 57 , 740 – 752 .
   Web of Science ®Google Scholar