References
- DermanCFinite State Markovian Decision Processes1970
- HeQ-MQuasi-birth-and-death Markov processes with a tree structure and the MMAP[K]/PH[K]/N/LCFS non-preemptive queueEuropean Journal of Operational Research2000120364165610.1016/S0377-2217(98)00396-8
- KeilsonJGreen’s Function Methods in Probability Theory1965
- LippmanSApplying a new device in the optimization of exponential queuing systemsOperations Research197523468770910.1287/opre.23.4.687
- LowDWOptimal dynamic pricing policies for an M/M/s queueOperations Research197422354556110.1287/opre.22.3.545
- MillerBLCountable-state average-cost regenerative stopping problemsJournal of Applied Probability198118236137710.1017/S0021900200098028
- PutermanMLMarkov Decision Processes: Discrete Stochastic Dynamic Programming1994
- RossSMApplied Probability Models with Optimization Applications1970
- SerfozoROptimal control of random walks, birth and death processes, and queuesAdvances in Applied Probability1981131618310.1017/S0001867800035795
- StidhamSJrWeberRRMonotonic and insensitive optimal policies for control of queues with undiscounted costsOperations Research198987461162510.1287/opre.37.4.611
- StidhamSJrWeberRRMonotone optimal policies for left-skip-free Markov decision processesContributions in Applied Probability and Stochastic Processes (in Honor of Julian Keilson)1999191202
- ThomasLCThe Wijngaard-Stidham bisection method and replacement modelsIEEE Transactions on Reliability1982R-31548248410.1109/TR.1982.5221441
- WhiteDJMarkov Decision Processes1993
- WhiteLBA new policy evaluation algorithm for Markov decision processes with quasi birth-death structureStochastic Models2005212–378579710.1081/STM-200056019
- WijngaardJStidhamSJrForward recursion for Markov decision processes with skip-free-to-the-right transitions, Part I: Theory and algorithmMathematics of Operations Research198611229520810.1287/moor.11.2.295
- WijngaardJStidhamSJrForward recursion for Markov decision processes with skip-free-to-the-right transitions, Part II: Non-standard applicationsStatistica Neerlandica200054216017410.1111/1467-9574.00134
- YeungRWSenguptaBMatrix product-form solutions for Markov chains with a tree structureAdvances in Applied Probability199426496598710.1017/S0001867800026719