A new class of distributed optimization algorithms: application to regression of distributed data

References

• Bhaduri , K. and Kargupta , H. 2008 . A scalable local algorithm for distributed multivariate regression . Stat. Anal. Data Min. , 1 ( 3 ) : 177 – 194 .
   Google Scholar
• Delouille , V. , Neelamani , R. and Baraniuk , R. Robust distributed estimation in sensor networks using the embedded polygons algorithm . Proceedings of the 3rd International Symposium on Information Processing in Sensor Networks . Berkeley , CA . pp. 405 – 413 .
   Google Scholar
• Guestrin , C. , Bodik , P. , Thibaux , R. , Paskin , M. and Madden , S. Distributed regression: An efficient framework for modeling sensor network data . Proceedings of Information Processing in Sensor Network . Berkeley , CA . pp. 1 – 10 .
   Google Scholar
• Hastie , T. , Tibshirani , R. and Friedman , J. 2001 . The Elements of Statistical Learning: Data Mining, Inference, and Prediction , New York : Springer-Verlag .
   Google Scholar
• Hershberger , D. and Kargupta , H. 2001 . Distributed multivariate regression using wavelet-based collective data mining . J. Parallel Distrib. Comput. , 61 ( 3 ) : 372 – 400 .
   Google Scholar
• Karr , A. , Lin , X. , Sanil , A. and Reiter , J. 2005 . Secure regression on distributed databases . J. Comput. Graph. Stat. , 14 ( 2 ) : 263 – 279 .
   Web of Science ®Google Scholar
• Khan , U. , Kar , S. and Moura , J. 2009 . “ Handbook on Sensor and Array Processing ” . Edited by: Haykin , S. and Ray Liu , K. J. New York : Wiley-Interscience . Distributed Algorithms in Sensor Networks
   Google Scholar
• Nedić , A. , Olshevsky , A. , Ozdaglar , A. and Tsitsiklis , J. N. Distributed subgradient algorithms and quantization effects . Proceedings of the 47th IEEE Conference on Decision and Control . Cancún , Mexico.
   Google Scholar
• Olfati-Saber , R. and Shamma , J. Consensus filters for sensor networks and distributed sensor fusion . Proceedings of the IEEE Conference on Decision and Control . Seville , Spain. Vol. 7 , pp. 6698 – 6703 .
   Google Scholar
• Polyak , B. T. 1987 . Introduction to Optimization , New York : Optimization Software Inc .
   Google Scholar
• Predd , J. B. , Kulkarni , S. R. and Poor , H. V. Regression in sensor networks: Training distributively with alternating projections . Proceedings of the SPIE Conference on Advanced Signal Processing Algorithms and Implementations XV . San Diego , CA . pp. 591006-1 – 591006-15 .
   Google Scholar
• Predd , J. B. , Kulkarni , S. R. and Poor , H. V. 2009 . A collaborative training algorithm for distributed learning . IEEE Trans. Inform. Theory , 55 ( 4 ) : 1856 – 1871 .
   Google Scholar
• Sanil , A. , Karr , A. and Lin , X. Privacy preserving regression modelling via distributed computation . Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . Seattle , WA . pp. 677 – 682 .
   Google Scholar
• Sundhar Ram , S. , Nedić , A. and Veeravalli , V. V. 2008 . Distributed stochastic subgradient algorithm for convex optimization . Available at http://arxiv.org/abs/0811.2595
   Google Scholar
• Sundhar Ram , S. , Nedić , A. and Veeravalli , V. V. Asynchronous gossip algorithms for stochastic optimization . Proceedings of the 48th Conference on Control, Decision and Control . Shanghai . China
   Google Scholar
• Sundhar Ram , S. , Nedić , A. and Veeravalli , V. V. 2009 . Incremental stochastic sub-gradient algorithms for convex optimization . SIAM J. Optim. , 20 ( 2 ) : 691 – 717 .
   Google Scholar
• Sundhar Ram , S. , Veeravalli , V. V. and Nedić , A. 2009 . “ Sensor Networks: When Theory Meets Practice ” . Edited by: Ferrari , G. Berlin/Heidelberg : Springer . Distributed and Recursive Estimation
   Google Scholar
• Sundhar Ram , S. , Veeravalli , V. V. and Nedić , A. Distributed and non-autonomous power control through distributed convex optimization . The 28th IEEE Conference on Computer Communications INFOCOM, Rio de Janeiro . April 19–25 , Brazil. pp. 3001 – 3005 .
   Google Scholar
• Xing , Y. , Madden , M. , Duggan , J. and Lyons , G. 2003 . Advances in Intelligent Data Analysis V , Vol. 2811/2003 , 544 – 553 . Berlin/Heidelberg : Springer . Lecture Notes in Computer Science, Distributed Regression for Heterogeneous Datasets
   Google Scholar
• Yu , H. and Chang , E.-C. Distributed multivariate regression based on influential observations . Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . Washington , DC . pp. 679 – 684 .
   Google Scholar