Learning automata decision analysis for sensor placement

References

• Andriyenko, A., Schindler, K., & Roth, S. (2012). Discrete-continuous optimization for multi-target tracking. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1926–1933.
   Google Scholar
• Atkinson, R. C., Bower, G. H., & Crothers, E. J. (1965). An introduction to mathematical learning theory. New York, NY: Wiley.
   Google Scholar
• Bailey, M. D., Shechter, S. M., & Schaefer, A. J. (2006). SPAR: Stochastic programming with adversarial recourse. Operations Research Letters, 34(3), 307–315.10.1016/j.orl.2005.05.002
   Web of Science ®Google Scholar
• Bar-Shalom, Y., Willett, P. K., & Tian, X. (2011). Tracking and data fusion. Storrs, CT: YBS publishing.
   Google Scholar
• Benfold, B., & Reid, I. (2011). Stable multi-target tracking in real-time surveillance video. Computer Vision and Pattern Recognition (CVPR), 3457–3464.
   Google Scholar
• Ben-Zvi, T., & Nickerson, J. V. (2007). Responding to changing situations: Learning automata for sensor placement. Proceeding of the Military Communications Conference (MILCOM), Orlando, Florida.
   Google Scholar
• Ben-Zvi, T., & Nickerson, J. V. (2011). Decision analysis: Environmental learning automata for sensor placement. IEEE Sensors Journal, 11(5), 1206–1207.10.1109/JSEN.2010.2089787
   Web of Science ®Google Scholar
• Berclaz, J., Fleuret, F., Turetken, E., & Fua, P. (2011). Multiple object tracking using k-shortest paths optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(9), 1806–1819.10.1109/TPAMI.2011.21
   PubMed Web of Science ®Google Scholar
• Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2011). Online multiperson tracking-by-detection from a single, uncalibrated camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(9), 1820–1833.10.1109/TPAMI.2010.232
   Web of Science ®Google Scholar
• Broennimann, O., Fitzpatrick, M. C., Pearman, P. B., Petitpierre, B., Pellissier, L., Yoccoz, N. G., … Graham, C. H. (2012). Measuring ecological niche overlap from occurrence & spatial environmental data. Global Ecology and Biogeography, 21, 481–497.10.1111/geb.2012.21.issue-4
   Web of Science ®Google Scholar
• Bush, R. R., & Mosteller, F. (1955). Stochastic models for learning. New York, NY: Wiley.10.1037/14496-000
   Google Scholar
• Chernonog, T., Avinadav, T., & Ben-Zvi, T. (2015). Pricing and sales-effort investment under bi-criteria in a supply chain of virtual products involving risk. European Journal of Operational Research, 246(2), 471–475.10.1016/j.ejor.2015.05.024
   Web of Science ®Google Scholar
• Esnaashari, M., & Meybodi, M. R. (2010). A learning automata based scheduling solution to the dynamic point coverage problem in wireless sensor networks. Computer Networks, 54(14), 2410–2438.10.1016/j.comnet.2010.03.014
   Web of Science ®Google Scholar
• Fu, K. S. (1967). Stochastic automata as models of learning systems. In J. T. Lou (Ed.), Computer and information sciences II (pp. 393–431). New York, NY: Academic Press.
   Google Scholar
• Fu, K. S., & Li, T. J. (1969). Formulation of learning automata and automata games. Information Science, 1(3), 237–256.10.1016/S0020-0255(69)80010-1
   Web of Science ®Google Scholar
• Georgas, N., & Blumberg, A. F. (2010). Establishing confidence in marine forecast systems: The design and skill assessment of the New York Harbor Observation and Prediction System, version 3 (NYHOPS v3). Proceedings of the Eleventh International Conference in Estuarine and Coastal Modeling (pp. 660–685, American Society of Civil Engineering, Seattle, Wash.
   Google Scholar
• Gosavi, A. (2009). Reinforcement learning: A tutorial survey and recent advances. INFORMS Journal on Computing, 21(2), 178–192.10.1287/ijoc.1080.0305
   Web of Science ®Google Scholar
• Gosavi, A. (2014). Simulation-based optimization: Parametric optimization techniques and reinforcement learning. New York, NY: Springer.
   Google Scholar
• Gosavi, A., Das, T. K., & Sarkar, S. (2004). A simulation-based learning automata framework for solving semi-Markov decision problems under long-run average reward. IIE Transactions, 36, 557–567.10.1080/07408170490438672
   Web of Science ®Google Scholar
• Granmo, O., Oommen, B., Myrer, S., & Olsen, M. (2007). Learning automata-based solutions to the nonlinear fractional knapsack problem with applications to optimal resource allocation. IEEE Transactions on Systems, Man and Cybernetics. Part B Cybernetics, 37(1), 166–175.10.1109/TSMCB.2006.879012
   Web of Science ®Google Scholar
• Haley, K. (Ed.). (2012). Search theory and applications. Berlin: Springer Science & Business Media.
   Google Scholar
• Jacobs, R. A. (1988). Increased rates of convergence through learning rate adaptation. Neural Networks, 1(4), 295–307.10.1016/0893-6080(88)90003-2
   Web of Science ®Google Scholar
• Jiang, B., Ravindran, B., & Cho, H. (2013). Probability-based prediction and sleep scheduling for energy-efficient target tracking in sensor networks. IEEE Transactions on Mobile Computing, 12(4), 735–747.10.1109/TMC.2012.44
   Web of Science ®Google Scholar
• Jin, X., Guan, N., Wang, J., & Zeng, P. (2015). Analyzing multimode wireless sensor networks using the network calculus. Journal of Sensors, Article ID 851608, 12 pages.
   Google Scholar
• Jung, N.-C., Popescu, I., Kelderman, P., Solomatine, D., & Price, R. (2010). Application of model trees and other machine learning techniques for algal growth prediction in Yongdam reservoir, Republic of Korea. Journal of Hydroinformatics, 12(3), 262–274.10.2166/hydro.2009.004
   Web of Science ®Google Scholar
• Kanevski, M., Timonin, V., & Pozdnukhov, A. (2009). Machine learning for spatial environmental data: Theory, applications and software. Lausanne: EPFL Press.10.1201/9781439808085
   Google Scholar
• Kwon, J., & Lee, K. M. (2011). Tracking by sampling trackers. IEEE International Conference on Computer Vision, 1195–1202.
   Google Scholar
• Le Cadre, H. (2014). Infrastructure topology optimization under competition through cross-entropy. Journal of the Operational Research Society, 65(6), 824–841.10.1057/jors.2012.96
   Web of Science ®Google Scholar
• Lee, S. (2007). Landslide susceptibility mapping using an artificial neural network in the Gangneung area, Korea. International Journal of Remote Sensing, 28(21), 4763–4783.10.1080/01431160701264227
   Web of Science ®Google Scholar
• Li, J., Heap, A. D., Potter, A., & Daniell, J. (2011). Application of machine learning methods to spatial interpolation of environmental variables. Environmental Modelling and Software, 26, 1647–1659.10.1016/j.envsoft.2011.07.004
   Web of Science ®Google Scholar
• Liang, F., Liu, C., & Carroll, R. (2010). Advanced Markov chain Monte Carlo methods: Learning from past samples. Hoboken, NJ: John Wiley & Sons Inc.10.1002/9780470669723
   Google Scholar
• Lin, F. Y. S., & Chiu, P. L. (2005). A near-optimal sensor placement algorithm to achieve complete coverage-discrimination in sensor networks. IEEE Communications Letters, 9(1), 43–45.
   Web of Science ®Google Scholar
• Marjanovic, M., Kovacevic, M., Bajat, B., & Vozenilek, V. (2011). Landslide susceptibility assessment using SVM machine learning algorithm. Engineering Geology, 123(3), 225–234.10.1016/j.enggeo.2011.09.006
   Web of Science ®Google Scholar
• Martin, R., & Tilak, O. (2012). On ε-optimality of the pursuit learning algorithm. Journal of Applied Probability, 49(3), 795–805.10.1017/S0021900200009542
   Web of Science ®Google Scholar
• Martinez, S., & Bullo, F. (2006). Optimal sensor placement and motion coordination for target tracking. Automatica, 42, 661–668.10.1016/j.automatica.2005.12.018
   Web of Science ®Google Scholar
• Misra, S., Krishna, P. V., & Abraham, K. I. (2011). An adaptive learning scheme for medium access with channel reservation in wireless networks. Wireless Personal Communications, 56(1), 55–72.10.1007/s11277-009-9883-0
   Web of Science ®Google Scholar
• Misra, S., Tiwari, V., & Obaidat, M. S. (2009). LACAS: Learning automata-based congestion avoidance scheme for healthcare wireless sensor networks. IEEE JSAC, 27(4), 466–479.
   Google Scholar
• Narendra, K. S., & Thathachar, M. A. L. (2012). Learning automata: An introduction. New York, NY: Dover Publications.
   Google Scholar
• Nicopolitidis, P., Papadimitriou, G., Pomportsis, A., Sarigiannidis, P., & Obaidat, M. S. (2011). Adaptive wireless networks using learning automata. IEEE Wireless Communications, 18(2), 75–81.10.1109/MWC.2011.5751299
   Web of Science ®Google Scholar
• Nowe, A., Verbeeck, K., & Peeters, M. (2006). Learning automata as a basis for multi-agent reinforcement learning. Lecture Notes in Computer Science, 3898, 71–85.10.1007/11691839
   Google Scholar
• Obaidat, M. S., Papadimitrou, G. I., & Pomportsis, A. S. (2002). Learning automata: Theory, paradigms, and applications. IEEE Transactions on Systems, Man, and Cybernetics – Part B, 32(6), 706–709.10.1109/TSMCB.2002.1049604
   Web of Science ®Google Scholar
• Orton, P. N., Georgas, N., Blumberg, A., & Pullen, J. (2012). Detailed modeling of recent severe storm tides in estuaries of the New York City region. Journal of Geophysical Research, 117, C09030. doi:10.1029/2012JC008220
   Web of Science ®Google Scholar
• Phillips, S. J., Anderson, R. P., & Schapire, R. E. (2006). Maximum entropy modeling of species geographic distributions. Ecological Modelling, 190, 231–259.10.1016/j.ecolmodel.2005.03.026
   Web of Science ®Google Scholar
• Pyayt, A. L., Mokhov, I. I., Lang, B., Krzhizhanovskaya, V. V., & Meijer, R. J. (2011). Machine learning methods for environmental monitoring and flood protection, World Academy of Science, Engineering and Technology. International Journal of Computer, Electrical, Automation, Control and Information Engineering, 5(6), 549–554.
   Google Scholar
• Ristic, B., Vo, B. N., Clark, D., & Vo, B. T. (2011). A metric for performance evaluation of multi-target tracking algorithms. IEEE Transactions on Signal Processing, 59(7), 3452–3457.10.1109/TSP.2011.2140111
   Web of Science ®Google Scholar
• Rubinstein, R. Y., & Kroese, D. P. (2013). The cross-entropy method: A unified approach to combinatorial optimization, Monte-Carlo simulation and machine learning. Berlin: Springer Science & Business Media.10.1002/9781118612323.ch2
   Google Scholar
• Simon, H. A. (1959). Theories of decision-making in economics and behavioral science. The American Economic Review, 49(3), 253–283.
   Web of Science ®Google Scholar
• Simonin, C., Le Cadre, J. P., & Dambreville, F. (2007). The cross-entropy method for solving a variety of hierarchical search problems. The 10th International Conference on Information Fusion.
   Google Scholar
• Stone, L. D., Streit, R. L., Corwin, T. L., & Bell, K. L. (2013). Bayesian multiple target tracking. Norwood, MA: Artech House.
   Google Scholar
• Thathachar, M. A. L., & Sastry, P. S. (2004). Networks of learning automata: Techniques for online stochastic optimization. New York, NY: Springer.10.1007/978-1-4419-9052-5
   Google Scholar
• Tien Bui, D., Pradhan, B., Lofman, O., & Revhaug, I. (2012). Landslide susceptibility assessment in Vietnam using Support vector machines, Decision tree and Naıve Bayes models. Mathematical Problems in Engineering, Article ID 974638.
   Web of Science ®Google Scholar
• Torkestani, J. A., & Meybodi, M. R. (2010). Mobility-based multicast routing algorithm for wireless mobile Ad-hoc networks: A learning automata approach. Computer Communications, 33(6), 721–735.10.1016/j.comcom.2009.11.019
   Web of Science ®Google Scholar
• Tsai, D., Flagg, M., Nakazawa, A., & Rehg, J. M. (2012). Motion coherent tracking using multi-label MRF optimization. International Journal of Computer Vision, 100(2), 190–202.10.1007/s11263-011-0512-5
   Web of Science ®Google Scholar
• Turkogullari, Y. B., Aras, N., Altinel, I. K., & Ersoy, C. (2010). Optimal, placement, scheduling and routing to maximize lifetime in sensor networks. Journal of the Operational Research Society, 61, 1000–1012.10.1057/jors.2008.187
   Web of Science ®Google Scholar
• Unsal, C., Bay, J. S., & Kachroo, P. (1995). Intelligent control of vehicles: Preliminary results on the application of learning automata techniques to automated highway system. Proceedings of the 7th International Conference on Tools Artificial Intelligence, 216–223.
   Google Scholar
• Varshavski, V. I., & Vorontsova, I. P. (1963). On the behavior of stochastic automata with variable structure. Automat. Telemekh, 24, 253–360.
   Google Scholar
• Vermeulen, J. F. J., & van den Brink, M. (2005). The search for an alerted moving target. Journal of the Operational Research Society, 56, 514–525.10.1057/palgrave.jors.2601847
   Web of Science ®Google Scholar
• Wallace, J., Tsoularis, A., & Tassabehji, R. (2006). Stochastic automata and supply chain agility in the time-limited supply industry. International Journal of Agile Systems and Management (IJASM), 1(4), 407–421.10.1504/IJASM.2006.011632
   Google Scholar
• Wheeler, R., & Narendra, K. S. (1986). Decentralized learning in Finite Markov chains. IEEE Transactions on Automatic Control, 31(6), 373–376.
   Web of Science ®Google Scholar
• Zeng, X., & Liu, Z. (2005). A learning automata based algorithm for optimization of continuous complex functions. Information Sciences, 174, 165–175.10.1016/j.ins.2004.09.004
   Web of Science ®Google Scholar
• Zhu, Q., Han, Z., & Basar, T. (2010). No-regret learning in collaborative spectrum sensing with malicious nodes. Proceedings of the IEEE International Conference on Communications (ICC ‘10), Cape Town, South Africa.
   Google Scholar