POMDP and MOMDP solutions for structural life-cycle cost minimization under partial and mixed observability

References

• Andriotis, C.P., & Papakonstantinou, K.G. (2018). Extended and generalized fragility functions. ASCE Journal of Engineering Mechanics, in press.
   Google Scholar
• Barto, A.G., Bradtke, S.J., & Singh, S.P. (1995). Learning to act using real-time dynamic programming. Artificial Intelligence, 72(1–2), 81–138.10.1016/0004-3702(94)00011-O
   Web of Science ®Google Scholar
• Bellman, R.E. (1957). Dynamic programming. Princeton, NJ, USA: Princeton University Press.
   Google Scholar
• Bertsekas, D. (2005). Dynamic programming and optimal control, Vol. I (3rd ed.). Nashua, NH, USA: Athena Scientific.
   Google Scholar
• Biondini, F., & Frangopol, D.M. (2016). Life-cycle performance of deteriorating structural systems under uncertainty: Review. Journal of Structural Engineering, 142(9), F4016001: 1–17.10.1061/(ASCE)ST.1943-541X.0001544
   Web of Science ®Google Scholar
• Corotis, R.B., Ellis, J. H., & Jiang, M. (2005). Modeling of risk-based inspection, maintenance and life-cycle cost with partially observable Markov decision processes. Structure and Infrastructure Engineering, 1(1), 75–84.10.1080/15732470412331289305
   Web of Science ®Google Scholar
• Ellis, H., Jiang, M., & Corotis, R.B. (1995). Inspection, maintenance, and repair with partial observability. Journal of Infrastructure Systems, 1(2), 92–99.10.1061/(ASCE)1076-0342(1995)1:2(92)
   Google Scholar
• Frangopol, D.M., Kallen, M.J., & Van Noortwijk, J.M. (2004). Probabilistic models for life-cycle performance of deteriorating structures: Review and future directions. Progress in Structural Engineering and Materials, 6(4), 197–212.10.1002/(ISSN)1528-2716
   Google Scholar
• Frangopol, D.M., & Soliman, M. (2016). Life-cycle of structural systems: Recent achievements and future directions. Structure and Infrastructure Engineering, 12(1), 1–20.10.1080/15732479.2014.999794
   Web of Science ®Google Scholar
• Kurniawati, H., Hsu, D., & Lee, W.S. (2008, June 25–28). SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In Proceedings of the robotics: Science and systems IV, Zurich, Switzerland.
   Google Scholar
• Madanat, S., & Ben-Akiva, M. (1994). Optimal inspection and repair policies for infrastructure facilities. Transportation Science, 28(1), 55–62.10.1287/trsc.28.1.55
   Web of Science ®Google Scholar
• Memarzadeh, M., & Pozzi, M. (2016). Integrated inspection scheduling and maintenance planning for infrastructure systems. Computer-aided Civil and Infrastructure Engineering, 31(6), 403–415.10.1111/mice.2016.31.issue-6
   Web of Science ®Google Scholar
• Memarzadeh, M., Pozzi, M., & Kolter, J. (2016). Hierarchical modeling of systems with similar components: A framework for adaptive monitoring and control. Reliability Engineering & System Safety, 153, 159–169.10.1016/j.ress.2016.04.016
   Web of Science ®Google Scholar
• Ong, S.C., Png, S.W., Hsu, D., & Lee, W.S. (2010). Planning under uncertainty for robotic tasks with mixed observability. The International Journal of Robotics Research, 29(8), 1053–1068.10.1177/0278364910369861
   Web of Science ®Google Scholar
• Papakonstantinou, K.G., & Shinozuka, M. (2013). Probabilistic model for steel corrosion in reinforced concrete structures of large dimensions considering crack effects. Engineering Structures, 57, 306–326.10.1016/j.engstruct.2013.06.038
   Web of Science ®Google Scholar
• Papakonstantinou, K.G., & Shinozuka, M. (2014a). Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part I: Theory. Reliability Engineering & System Safety, 130, 202–213.10.1016/j.ress.2014.04.005
   Web of Science ®Google Scholar
• Papakonstantinou, K.G., & Shinozuka, M. (2014b). Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part II: POMDP implementation. Reliability Engineering & System Safety, 130, 214–224.10.1016/j.ress.2014.04.006
   Web of Science ®Google Scholar
• Papakonstantinou, K.G., & Shinozuka, M. (2014c). Optimum inspection and maintenance policies for corroded structures using partially observable Markov decision processes and stochastic, physically based models. Probabilistic Engineering Mechanics, 37, 93–108.10.1016/j.probengmech.2014.06.002
   Web of Science ®Google Scholar
• Sánchez-Silva, M., Frangopol, D.M., Padgett, J., & Soliman, M. (2016). Maintenance and operation of infrastructure systems: Review. Journal of Structural Engineering, 142(9), F4016004: 1–16.10.1061/(ASCE)ST.1943-541X.0001543
   Web of Science ®Google Scholar
• Schöbi, R., & Chatzi, E.N. (2016). Maintenance planning using continuous-state partially observable Markov decision processes and non-linear action models. Structure and Infrastructure Engineering, 12(8), 977–994.10.1080/15732479.2015.1076485
   Web of Science ®Google Scholar
• Shani, G., Pineau, J., & Kaplow, R. (2013). A survey of point-based POMDP solvers. Autonomous Agents and Multi-agent Systems, 27(1), 1–51.10.1007/s10458-012-9200-2
   Web of Science ®Google Scholar
• Smith, T. (2007). Probabilistic planning for robotic exploration ( Phd thesis). Pittsburgh, PA: Carnegie Mellon University.
   Google Scholar
• Smith, T., & Simmons, R. (2004, July 07–11). Heuristic search value iteration for POMDPs. In: Proceedings of the 20th conference on uncertainty in artificial intelligence (UAI ‘04) (pp. 512–519). Banff, Canada.
   Google Scholar
• Smith, T., & Simmons, R. (2005, July 26–29). Point-based POMDP algorithms: Improved analysis and implementation. In: Proceedings of the 21st conference on uncertainty in artificial intelligence (UAI ‘05) (pp. 520–527). Edinburgh, Scotland, UK.
   Google Scholar
• Smith, T., & Simmons, R. (2006, July 16–20). Focused real-time dynamic programming for MDPs: Squeezing more out of a heuristic. In: Proceedings of the 21st Conference on Artificial Intelligence (AAAI’06) (pp. 1227–1232). Boston, MA, USA.
   Google Scholar
• Spaan, M.T., & Vlassis, N. (2005). Perseus: Randomized point-based value iteration for POMDPs. Journal of Artificial Intelligence Research, 24, 195–220.
   Web of Science ®Google Scholar
• Straub, D., & Faber, M.H. (2005). Risk based inspection planning for structural systems. Structural Safety, 27(4), 335–355.10.1016/j.strusafe.2005.04.001
   Web of Science ®Google Scholar
• Van Noortwijk, J.M. (2009). A survey of the application of gamma processes in maintenance. Reliability Engineering & System Safety, 94(1), 2–21.10.1016/j.ress.2007.03.019
   Web of Science ®Google Scholar