Distributed density estimation in sensor networks based on variational approximations

References

• Attias, H. (1999), ‘Inferring Parameters and Structure of Latent Variable Models by Variational Bayes’, in Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, Stockholm, Sweden
   Google Scholar
• Attias , H . 2000 . “ A Variational Bayesian Framework for Graphical Models ” . In Advances in Neural Information Processing Systems, No. 12 , Edited by: Solla , S. , Leen , T. and Muller , K. 209 – 215 . Cambridge, MA : MIT Press .
   Google Scholar
• Besg , J . 1986 . On the Statistical Analysis of Dirty Pictures . Journal of Royal Statistics Society: Series B (Methodological) , 48 : 259 – 302 .
   Google Scholar
• Boyd, S., Ghosh, A., Prabhakar, B., and Shah, D. (2005), ‘Gossip Algorithms: Design, Analysis and Applications’, in Proceedings of IEEE Infocom’05, Miami, FL, USA
   Google Scholar
• Constantinopoulos , C and Likas , A . 2007 . Unsupervised Learning of Gaussian Mixtures Based on Variational Component Splitting . IEEE Transactions on Neural Networks , 18 : 745 – 755 .
   PubMed Web of Science ®Google Scholar
• Corduneanu , A and Bishop , CM . 2001 . “ Variational Bayesian Model Selection for Mixture Distributions ” . In Artificial Intelligence and Statistics , Edited by: Jaakkola , T. and Richardson , T. 27 – 34 . Los Altos, CA : Morgan Kaufman .
   Google Scholar
• Dempster , AP , Laird , N and Rubin , D . 1977 . Maximum Likelihood Estimation from Incomplete Data via the EM Algorithm . Journal of the Royal Statistical Society: Series B , 39 : 1 – 38 .
   Google Scholar
• Eugster , P , Guerraoui , R , Kermarrec , A-M and Massoulie , L . 2004 . From Epidemics to Distributed Computing . IEEE Computer , 37 : 60 – 67 .
   Web of Science ®Google Scholar
• Feng, J., and Zeng, M. (2010), ‘Optimal Distributed Kalman Filtering Fusion for a Linear Dynamic System with Cross-correlated Noises’, International Journal of Systems Science, DOI: 10.1080/00207721.2010.502601
   Google Scholar
• Gu , D . 2008 . Distributed EM Algorithm for Gaussian Mixtures in Sensor Networks . IEEE Transactions on Neural Networks , 19 : 1154 – 1166 .
   Web of Science ®Google Scholar
• Kemp, D., Dobra, A., and Gehrke, J. (2003), ‘Computing Aggregate Information Using Gossip’, in Proceedings of FoCS, Cambridge, MA, USA
   Google Scholar
• McGrory , CA and Titterington , DM . 2007 . Variational Approximations in Bayesian Model Selection for Finite Mixture Distributions . Computational Statistics and Data Analysis , 51 : 5352 – 5367 .
   Web of Science ®Google Scholar
• McLachlan , GJ and Krishnan , T . 1997 . The EM Algorithm and Extensions , New York : Wiley .
   Google Scholar
• Neal , R and Hinton , G . 1999 . “ A View of the EM Algorithm that Justifies Incremental, Sparse, and Other Variants ” . In Learning in Graphical Models , Edited by: Jordan , Michael I. 355 – 368 . Cambridge, MA : MIT Press .
   Google Scholar
• Nguyen , X , Jordan , MI and Sinopoli , B . 2005 . A Kernel-based Learning Approach to Ad hoc Sensor Network Localization . ACM Transactions on Sensor Networks , 1 : 134 – 152 .
   Google Scholar
• Nowak , RD . 2003 . Distributed EM Algorithms for Density Estimation and Clustering in Sensor Networks . IEEE Transactions on Signal Processing , 51 : 2245 – 2253 .
   Web of Science ®Google Scholar
• Ordonez , C and Omiecinski , E . 2005 . Accelerating EM Clustering to Find High-quality Solutions . Knowledge and Information Systems , 7 : 135 – 157 .
   Web of Science ®Google Scholar
• Paskin, M.A., and Guestrin, C.E. (2004), ‘Robust Probabilistic Inference in Distributed Systems’, in Proceedings of the 20th conference on Uncertainty in Artificial Intelligence, Banff, Canada
   Google Scholar
• Paskin, M., Guestrin, C., and McFadden, J. (2005), ‘A Robust Architecture for Inference in Distributed Sensor Networks’, in International Conference on Information Processing in Sensor Networks (IPSN), LOS Angeles, CA, USA
   Google Scholar
• Penny, W.D., and Roberts, S.J. (2000), ‘Variational Bayes for 1-Dimensional Mixture Models’, Technical Report PARG-2000-01, Oxford University, Department of Engineering Science
   Google Scholar
• Roweis , S and Ghahramani , Z . 1999 . A Unifying Review of Linear Gaussian Models . Neural Computation , 11 : 305 – 345 .
   PubMed Web of Science ®Google Scholar
• Safarinejadian , B , Menhaj , MB and Karrari , M . 2009a . Distributed Data Clustering Using Expectation Maximization Algorithm . Journal of Applied Sciences , 9 : 854 – 864 .
   Google Scholar
• Safarinejadian , B , Menhaj , MB and Karrari , M . 2009b . A Distributed Variational Bayesian Algorithm for Density Estimation in Sensor Networks . IEICE Transactions on Information and Systems , E92-D : 1037 – 1048 .
   Google Scholar
• Safarinejadian , B , Menhaj , MB and Karrari , M . 2010a . A Distributed EM Algorithm to Estimate the Parameters of a Finite Mixture of Components . Knowledge and Information Systems , 23 : 267 – 292 .
   Google Scholar
• Safarinejadian , B , Menhaj , MB and Karrari , M . 2010b . Distributed Variational Bayesian Algorithms for Gaussian Mixtures in Sensor Networks . Signal Processing , 90 : 1197 – 1208 .
   Web of Science ®Google Scholar
• Shang, Y. (2010), ‘Finite-Time Consensus for Multi-agent Systems With Fixed Topologies’, International Journal of Systems Science, DOI:10.1080/00207721.2010.517857
   Google Scholar
• Shen, B., Wang, Z., Hung, Y.S., and Chesi, G. (2011), ‘Distributed H-infinity Filtering for Polynomial Nonlinear Stochastic Systems in Sensor Networks’, IEEE Transactions on Industrial Electronics, DOI: 10.1109/TIE.2010.2053339
   Google Scholar
• Shen , B , Zidong , W and Hung , YS . 2010 . Distributed Consensus H-infinity Filtering in Sensor Networks with Multiple Missing Measurements: The Finite-Horizon Case . Automatica , 46 : 1682 – 1688 .
   Web of Science ®Google Scholar
• Simic , S . 2003 . A Learning-Theory Approach to Sensor Networks . IEEE Pervasive Computing , 2 : 44 – 49 .
   Google Scholar
• Verbeek, J.J., Vlassis, N. and Nunnink, J.R.J. (2003), ‘A Variational EM Approach for Large-scale Mixture Modeling’, in Proceedings of 8th Annual Conference of the Advanced School of Computing and Imaging, Heijen, The Netherlands
   Google Scholar
• Wang , Z , Wang , Y and Liu , Y . 2010 . Global Synchronization for Discrete-Time Stochastic Complex Networks with Randomly Occurred Nonlinearities and Mixed Time-delays . IEEE Transactions on Neural Networks , 21 : 11 – 25 .
   PubMed Web of Science ®Google Scholar