Optimization Transfer Using Surrogate Objective Functions

References

• Becker , M. P. , Yang , I. and Lange , K. 1997 . “EM Algorithms Without Missing Data” . Statistical Methods in Medical Research , 6 : 38 – 54 .
   PubMedGoogle Scholar
• Böhning , D. 1992 . “Multinomial Logistic Regression Algorithm” . Annals Institute of Statistical Mathematics , 44 : 197 – 200 .
   Google Scholar
• Böhning , D. and Lindsay , B. G. 1988 . “Monotonicity of Quadratic Approximation Algorithms” . Annals Institute of Statistical Mathematics , 40 : 641 – 663 .
   Web of Science ®Google Scholar
• Borg , I. and Groenen , P. 1997 . Modern Multidimensional Scaling , New York : Springer-Verlag .
   Google Scholar
• Boyer , R. and Savageau , D. 1989 . Places Rated Almanac , New York : Prentice Hall .
   Google Scholar
• Bradley , R. A. and Terry , M. E. 1952 . “Rank Analysis of Incomplete Block Designs” . Biometrika , 39 : 324 – 345 .
   Web of Science ®Google Scholar
• Conn , A. R. , Gould , N. I. M. and Toint , P. L. 1991 . “Convergence of Quasi-Newton Matrices Generated by the Symmetric Rank One Update” . Mathematical Programming , 50 : 177 – 195 .
   Web of Science ®Google Scholar
• Davidon , W. C. 1959 . “Variable Metric Methods for Minimization” , Argonne National Laboratory . AEC Research and Development Report ANL-5990
   Google Scholar
• de Leeuw , J. 1994 . “Block Relaxation Algorithms in Statistics” . In Information Systems and Data Analysis , Edited by: Bock , H. H. , Lenski , W. and Richter , M. M. 308 – 325 . Berlin : Springer-Verlag .
   Google Scholar
• de Leeuw , J. and Heiser , W. J. 1977 . “Convergence of Correction Matrix Algorithms for Multidimensional Scaling” . In Geometric Representations of Relational Data , Edited by: Lingoes , J. C. , Roskam , E. and Borg , I. 735 – 752 . Ann Arbor : Mathesis Press .
   Google Scholar
• de Leeuw , J. and Heiser , W. J. 1980 . “Multidimensional Scaling With Restrictions on the Configuration” . In Multivariate Analysis, Vol. V , Edited by: Krishnaiah , P. R. 501 – 522 . Amsterdam : North-Holland .
   Google Scholar
• Dempster , A. P. , Laird , N. M. and Rubin , D. B. 1977 . “Maximum Likelihood From Incomplete Data via the EM Algorithm” . Journal of the Royal Statistical Society , 39 : 1 – 38 . Series B
   Google Scholar
• De Pierro , A. R. 1995 . “A Modified Expectation Maximization Algorithm for Penalized Likelihood Estimation in Emission Tomography” . IEEE Transactions on Medical Imaging , 14 : 132 – 137 .
   PubMed Web of Science ®Google Scholar
• Efron , B. 1991 . “Regression Percentiles Using Asymmetric Squared Error Loss” . Statistica Sinica , 1 : 93 – 125 .
   Web of Science ®Google Scholar
• Groenen , P. J. F. 1993 . The Majorization Approach to Multidimensional Scaling: Some Problems and Extensions , Leiden , , The Netherlands : DSWO Press .
   Google Scholar
• Heiser , W. J. 1995 . “Convergent Computing by Iterative Majorization: Theory and Applications in Multidimensional Data Analysis” . In Recent Advances in Descriptive Multivariate Analysis , Edited by: Krzanowski , W. J. 157 – 189 . Oxford : Clarendon Press .
   Google Scholar
• Horn , R. A. and Johnson , C. R. 1985 . Matrix Analysis , Cambridge : Cambridge University Press .
   Google Scholar
• Householder , A. S. 1975 . The Theory of Matrices in Numerical Analysis , New York : Dover .
   Google Scholar
• Huber , P. J. 1981 . Robust Statistics , New York : Wiley .
   Google Scholar
• Hunter , D. R. and Lange , K. 1999 . “Computing Estimates in the Proportional Odds Model” unpublished manuscript
   Google Scholar
• Hunter , D. R. and Lange , K. 2000 . “Quantile Regression van an MM Algorithm” . Journal of Compuational and Graphical Statistics , 9 : 60 – 77 .
   Web of Science ®Google Scholar
• Jamshidian , M. and Jennrich , R. I. 1993 . “Conjugate Gradient Acceleration of the EM Algorithm” . Journal of the American Statistical Association , 88 : 221 – 228 .
   Web of Science ®Google Scholar
• Jamshidian , M. and Jennrich , R. I. 1997 . “Quasi-Newton Acceleration of the EM Algorithm” . Journal of the Royal Statistical Society , 59 : 569 – 587 . Series B
   Google Scholar
• Keener , J. P. 1993 . “The Perron-Frobenius Theorem and the Ranking of Football Teams” . SIAM Review , 35 : 80 – 93 .
   Web of Science ®Google Scholar
• Khalfan , H. F. , Byrd , R. H. and Schnabel , R. B. 1993 . “A Theoretical and Experimental Study of the Symmetric Rank-One Update” . SIAM Journal on Optimization , 3 : 1 – 24 .
   Web of Science ®Google Scholar
• Konno , H. , Thach , P. T. and Tuy , H. 1997 . Optimization on Low Rank Nonconvex Structures , Dordecht , , The Netherlands : Kluwer Academic Publishers .
   Google Scholar
• Lange , K. 1994 . “An Adaptive Barrier Method for Convex Programming” . Methods Applications Analysis , 1 : 392 – 402 .
   Google Scholar
• Lange , K. 1995a . “A Quasi-Newton Acceleration of the EM Algorithm” . Statistica Sinica , 5 : 1 – 18 .
   Web of Science ®Google Scholar
• Lange , K. 1995b . “A Gradient Algorithm Locally Equivalent to the EM Algorithm” . Journal of the Royal Statistical Society , 57 : 425 – 437 . Series B
   Google Scholar
• Lange , K. and Fessler , J. A. 1995c . “Globally Convergent Algorithms for Maximum A Posteriori Transmission Tomography” . IEEE Transactions on Image Processing , 4 : 1430 – 1438 .
   PubMed Web of Science ®Google Scholar
• Lange , K. , Little , R. J. A. and Taylor , J. M. G. 1989 . “Robust Statistical Modeling Using the t Distribution” . Journal of the American Statistical Association , 84 : 881 – 896 .
   Web of Science ®Google Scholar
• Lange , K. and Sinsheimer , J. 1993 . “Normal/Independent Distributions and Their Applications in Robust Regression” . Journal of Computational and Statistical Graphics , 2 : 175 – 198 .
   Google Scholar
• Little , R. J. A. and Rubin , D. B. 1987 . Statistical Analysis with Missing Data , New York : Wiley .
   Google Scholar
• Luenberger , D. G. 1984 . Linear and Nonlinear Programming, , 2nd ed. , Reading , MA : Addison-Wesley .
   Google Scholar
• Marshall , A. W. and Olkin , I. 1979 . Inequalities: Theory of Majorization and its Applications , San Diego : Academic Press .
   Google Scholar
• McLachlan , G. J. and Krishnan , T. 1997 . The EM Algorithm and Extensions , New York : Wiley .
   Google Scholar
• Mosteller , F. and Tukey , J. W. 1977 . Data Analysis and Regression: A Second Course in Statistics , Reading , MA : Addison-Wesley .
   Google Scholar
• Ortega , J. M. and Rheinboldt , W. C. 1970 . Iterative Solutions of Nonlinear Equations in Several Variables , New York : Academic Press .
   Google Scholar
• Peressini , A. L. , Sullivan , F. E. and Uhl , J. J. Jr. 1988 . The Mathematics of Nonlinear Programming , New York : Springer .
   Google Scholar
• Press , W. H. , Teukolsky , S. A. , Vetterling , W. T. and Flannery , B. P. 1992 . Numerical Recipes in Fortran: The Art of Scientific Computing, , 2nd ed. , Cambridge : Cambridge University Press .
   Google Scholar
• Rousseeuw , P. J. and Leroy , A. M. 1987 . Robust Regression and Outlier Detection , New York : Wiley .
   Google Scholar
• Schlossmacher , E. J. 1973 . “An Iterative Technique for Absolute Deviations Curve Fitting” . Journal of the American Statistical Association , 68 : 857 – 859 .
   Web of Science ®Google Scholar