Nenparametric Two-Group Classification: Concepts and a SAS-Based Software Package

References

• Abad , P. L. and Banks , W. J. 1993 . “New LP Based Heuristics for the Classification Problem,” . European Journal of Operational Research , 67 : 88 – 100 .
   Web of Science ®Google Scholar
• Agrawala , A. K. 1977 . Machine Recognition of Patterns , New York : IEEE Press .
   Google Scholar
• Albert , A. and Anderson , J. A. 1981 . “Probit and Logistic Discriminant Functions,” . Communications in Statistics–Theory and Methods , A10 : 641 – 657 .
   Google Scholar
• Anderson , J. A. 1972 . “Separate Sample Logistic Discrimination,” . Biometrika , 59 : 19 – 35 .
   Web of Science ®Google Scholar
• Anderson , J. A. 1975 . “Quadratic Logistic Discrimination,” . Biometrika , 62 : 149 – 154 .
   Web of Science ®Google Scholar
• Asparoukhov , O. K. 1985 . “Microprocessor System for Investigation of Thromboembolic Complications,” , Bulgaria : Technical University of Sofia . unpublished PhD dissertation
   Google Scholar
• Bajgier , S. M. and Hill , A. V. 1982 . “An Experimental Comparison of Statistical and Linear Programming Approaches to the Discriminant Problem,” . Decision Sciences , 13 : 604 – 618 .
   Google Scholar
• Banks , W. J. 1991 . “New Solution Algorithms for the Classification Problem,” , Hamilton, Ontario , , Canada : McMaster University . unpublished doctoral thesis
   Google Scholar
• Banks , W. J. and Abad , P. L. 1991 . “An Efficient Optimal Solution Algorithm for the Classification Problem,” . Decision Sciences , 22 : 1008 – 1023 .
   Web of Science ®Google Scholar
• Banks , W. J. and Abad , P. L. 1994 . “On the Performance of Linear Programming Heuristics Applied on a Quadratic Transformation in the Classification Problem,” . European Journal of Operational Research , 74 : 23 – 28 .
   Web of Science ®Google Scholar
• Bayne , C. K. , Beauchamp , J. J. , Kane , V. E. and McCabe , G. P. 1983 . “Assessment of Fisher and Logistic Linear and Quadratic Discrimination Models,” . Computational Statistics and Data Analysis , 1 : 257 – 273 .
   Web of Science ®Google Scholar
• Breiman , L. , Meisel , W. and Purcell , E. 1977 . “Variable Kernel Estimates of Multivariate Densities,” . Technometrics , 19 : 135 – 144 .
   Web of Science ®Google Scholar
• Byth , K. and McLachlan , G. J. 1980 . “Logistic Regression Compared to Normal Discrimination for Non-normal Populations,” . Australian Journal of Statistics , 22 : 188 – 196 .
   Google Scholar
• Crawley , D. R. 1979 . “Logistic Discrimination as an Alternative to Fisher's Linear Discriminant Function,” . New Zealand Statistician , 14 : 21 – 25 .
   Google Scholar
• Delgado , M. A. and Stengos , T. 1990 . “N-Kernel: a Review,” . Journal of Applied Econometrics , 5 : 299 – 304 .
   Google Scholar
• Silva , A. P. Duarte . 1995 . “Minimizing the Misclassification Costs in Two-Group Classification Analysis,” , The University of Georgia, Terry College of Business . unpublished doctoral dissertation
   Google Scholar
• Silva , A. P. Duarte and Stam , A. 1994a . “Second Order Mathematical Programming Formulations for Classification in Two-Group Discriminant Analysis,” . European Journal of Operational Research , 72 : 4 – 22 .
   Web of Science ®Google Scholar
• Silva , A. P. Duarte and Stam , A. 1994b . “BestClass: A SAS-Based Software Package of Nonparametric Methods for Two-Group Classification,” , The University of Georgia, Terry College of Business . working paper 94–396
   Google Scholar
• Efron , B. 1975 . “The Efficiency of Logistic Regression Compared to Normal Discriminant Analysis,” . Journal of the American Statistical Association , 70 : 892 – 898 .
   Web of Science ®Google Scholar
• Epanechnikov , V. A. 1969 . “Nonparametric Estimation of a Multivariate Probability Density,” . Theory of Probability and its Applications , 14 : 153 – 158 .
   Web of Science ®Google Scholar
• Erenguc , S. S. and Koehler , G. J. 1990 . “Survey of Mathematical Programming Models and Experimental Results for Linear Discriminant Analysis,” . Managerial and Decision Economics , 11 : 215 – 225 .
   Web of Science ®Google Scholar
• Fatti , L. P. , Hawkins , D. M. and Raath , E. L. 1982 . “Discriminant Analysis,” . In Topics in Applied Multivariate Analysis , Edited by: Hawkins , D. M. 1 – 71 . Cambridge : Cambridge University Press .
   Google Scholar
• Fisher , R. A. 1936 . “The Use of Multiple Measurements in Taxonomy Problems,” . Annals of Eugenics , 7 : 179 – 188 .
   Google Scholar
• Fix , E. and Hodges , J. L. 1977 . “Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties,” , Randolph , TX : U.S. Air Force School of Aviation Medicine . report no. 4, 1951 (reprinted in Agrawala, A.K. (1977), Machine Recognition of Patterns, New York: IEEE Press, pp. 261–279)
   Google Scholar
• Freed , N. and Glover , F. 1981a . “A Linear Programming Approach to the Discriminant Problem,” . Decision Sciences , 12 : 68 – 74 .
   Google Scholar
• Freed , N. and Glover , F. 1981b . “Simple but Powerful Goal Programming Formulations for the Discriminant Problem,” . European Journal of Operational Research , 7 : 44 – 60 .
   Web of Science ®Google Scholar
• Freed , N. and Glover , F. 1986 . “Evaluating Alternative Linear Programming Models to Solve the Two-Group Discriminant Problem,” . Decision Sciences , 17 : 151 – 162 .
   Web of Science ®Google Scholar
• Gessaman , M. P. and Gessaman , P. H. 1972 . “A Comparison of Some Multivariate Discrimination Procedures,” . Journal of the American Statistical Association , 67 : 468 – 472 .
   Web of Science ®Google Scholar
• Glick , N. 1976 . “Sample-Based Classification Procedures Related to Empiric Distributions,” . IEEE Transactions on Information Theory , IT-22 : 454 – 461 .
   Google Scholar
• Glover , F. 1990 . “Improved Linear Programming Models for Discriminant Analysis,” . Decision Sciences , 21 : 771 – 785 .
   Web of Science ®Google Scholar
• Glover , F. , Keene , S. and Duea , B. 1988 . “A New Class of Models for the Discriminant Problem,” . Decision Sciences , 19 : 269 – 280 .
   Web of Science ®Google Scholar
• Hand , D. J. 1981 . Discrimination and Classification , New York : Wiley .
   Google Scholar
• Hand , D. J. 1982 . Kernel Discriminant Analysis , New York : Research Studies Press .
   Google Scholar
• Ibaraki , T. and Muroga , S. 1970 . “Adaptive Linear Classifier by Linear Programming,” . IEEE Transactions on Systems Science and Cybernetics , SSC-6 : 53 – 62 .
   Google Scholar
• Joaehimsthaler , E. A. and Stam , A. 1988 . “Four Approaches to the Classification Problem in Discriminant Analysis: An Experimental Study,” . Decision Sciences , 19 : 322 – 333 .
   Google Scholar
• Joaehimsthaler , E. A. and Stam , A. 1990 . “Mathematical Programming Approaches for the Classification Problem in Two-Group Discriminant Analysis,” . Multivariate Behavioral Research , 25 : 421 – 454 .
   PubMed Web of Science ®Google Scholar
• Koehler , G. J. 1989 . “Characterizations of Unacceptable Solutions in LP Discriminant Analysis,” . Decision Sciences , 20 : 239 – 257 .
   Google Scholar
• Koehler , G. J. and Erenguc , S. S. 1990 . “Minimizing Misclassifications in Linear Discriminant Analysis,” . Decision Sciences , 21 : 63 – 85 .
   Web of Science ®Google Scholar
• Koford , J. S. and Groner , G. F. 1966 . “The Use of an Adaptive Threshold Element to Design a Linear Optimal Pattern Classifier,” . IEEE Transactions on Information Theory , IT-12 : 42 – 50 .
   Web of Science ®Google Scholar
• Lachenbruch , P. A. and Mickey , M. R. 1968 . “Estimation of Error Rates in Discriminant Analysis,” . Technometrics , 10 : 1 – 11 .
   Web of Science ®Google Scholar
• Lachenbruch , P. A. , Sneeringer , C. and Revo , L. T. 1973 . “Robustness of the Linear and Quadratic Discriminant Function to Certain Types of Non-Normality,” . Communications in Statistics , 1 : 39 – 57 .
   Google Scholar
• Lam , K. F. and Choo , E. U. 1991 . “Software Package for Linear Programming in Classification Problems,” , Simon Fraser University, Faculty of Business Administration .
   Google Scholar
• Liittschwager , J. M. and Wang , C. 1978 . “Integer Programming Solution of a Classification Problem,” . Management Science , 24 : 1515 – 1525 .
   Web of Science ®Google Scholar
• Mahmood , M. O. and Lawrence , E. C. 1987 . “A Performance Analysis of Parametric and Nonparametric Discriminant Approaches to Business Decision Making,” . Decision Sciences , 18 : 308 – 326 .
   Web of Science ®Google Scholar
• Mangasarian , O. L. 1965 . “Linear and Nonlinear Separation of Patterns by Linear Programming,” . Operations Research , 13 : 444 – 452 .
   Web of Science ®Google Scholar
• Markowski , C. A. and Markowski , E. P. 1985 . “Some Difficulties and Improvements in Applying Linear Programming Formulations to the Discriminant Problem,” . Decision Sciences , 16 : 237 – 247 .
   Web of Science ®Google Scholar
• Marks , S. and Dunn , O. J. 1974 . “Discriminant Functions when Covariance Matrices are Unequal,” . Journal of the American Statistical Association , 69 : 555 – 559 .
   Web of Science ®Google Scholar
• McLachlan , G. J. 1992 . Discriminant Analysis and Statistical Pattern Recognition , New York : Wiley .
   Google Scholar
• Murphy , B. J. and Moran , M. A. 1986 . “Parametric and Kernel Density Methods in Discriminant Analysis: Another Comparison,” . Computers and Mathematics with Applications , 12A : 197 – 207 .
   Web of Science ®Google Scholar
• Ng , P. T. and Sickles , R. C. 1990 . “Xplore-ing the World of Nonparametric Analysis,” . Journal of Applied Econometrics , 5 : 293 – 298 .
   Google Scholar
• Parzen , E. 1962 . “On the Estimation of a Probability Density Function and the Mode,” . Annals of Mathematical Statistics , 33 : 1065 – 1076 .
   Google Scholar
• Press , S. J. and Wilson , S. 1978 . “Choosing Between Logistic Regression and Discriminant Analysis,” . Journal of the American Statistical Association , 73 : 699 – 705 .
   Web of Science ®Google Scholar
• Ragsdale , C. T. and Stam , A. 1991 . “Mathematical Programming Formulations for the Discriminant Problem: An Old Dog Does New Tricks,” . Decision Sciences , 22 : 296 – 307 .
   Web of Science ®Google Scholar
• Remme , J. , Habbema , J. D. F. and Hermans , J. 1980 . “A Simulative Comparison of Linear, Quadratic and Kernel Discrimination,” . Journal of Statistical Computing and Simulation , 11 : 87 – 106 .
   Web of Science ®Google Scholar
• Rubin , P. A. 1990a . “Heuristic Solution Procedures for a Mixed-Integer Programming Discriminant Model,” . Managerial and Decision Economics , 11 : 255 – 266 .
   Google Scholar
• Rubin , P. A. 1990b . “A Comparison of Linear Programming and Parametric Approaches to the Two-Group Discriminant Problem,” . Decision Sciences , 21 : 373 – 386 .
   Web of Science ®Google Scholar
• Rubin , P. A. 1994 . “A Comment Regarding Polynomial Discriminant Analysis,” . European Journal of Operational Research , 72 : 29 – 31 .
   Google Scholar
• SAS Institute Inc. 1989a . SAS/OR User's Guide, Version 6, , 1st ed. , Cary , NC : editor .
   Google Scholar
• SAS Institute Inc. 1989b . SAS/STAT User's Guide, Version 6, , 1st ed. , vol. 1 , Cary , NC : editor .
   Google Scholar
• SAS Institute Inc. 1989c . SAS/STAT User's Guide, Version 6, , 1st ed. , vol. 1 , Cary , NC : editor .
   Google Scholar
• SAS Institute Inc. 1990 . SAS Language: Reference, Version 6, , 1st ed. , Cary , NC : editor .
   Google Scholar
• Smith , C. A. B. 1947 . “Some Examples of Discrimination,” . Annals of Eugenics , 13 : 272 – 282 .
   PubMedGoogle Scholar
• Smith , F. W. 1968 . “Pattern Classifier Design by Linear Programming,” . IEEE Transactions on Computers , C-17 : 367 – 372 .
   Web of Science ®Google Scholar
• Soltysik , R. C. and Yarnold , P. R. 1993 . ODA 1.0: Optimal Data Analysis for DOS , Chicago , IL : Optimal Data Analysis, Inc. .
   Google Scholar
• Soltysik , R. C. and Yarnold , P. R. 1994 . “The Warmack-Gonzalez Algorithm for Linear Two-Category Multivariable Optimal Discriminant Analysis,” . Computers & Operations Research , 21 : 735 – 745 .
   Web of Science ®Google Scholar
• Stam , A. and Joachimsthaler , E. A. 1989 . “Solving the Classification Problem in Discriminant Analysis via Linear and Nonlinear Programming Methods,” . Decision Sciences , 20 : 285 – 293 .
   Google Scholar
• Stam , A. and Joachimsthaler , E. A. 1990 . “Comparison of a Robust Mixed-Integer Approach to Existing Methods for Establishing Classification Rules for the Discriminant Problem,” . European Journal of Operational Research , 46 : 113 – 122 .
   Web of Science ®Google Scholar
• Stam , A. and Jones , D. G. 1990 . “Classification Performance of Mathematical Programming Techniques in Discriminant Analysis: Results for Small and Medium Sample Sizes,” . Managerial and Decision Economics , 11 : 243 – 253 .
   Web of Science ®Google Scholar
• Stam , A. and Ragsdale , C. T. 1992 . “On the Classification Gap in MP-Based Approaches to the Discriminant Problem,” . Naval Research Logistic , 39 : 545 – 559 .
   Web of Science ®Google Scholar
• Stam , A. and Ungar , D. 1995 . “RAGNU: A Microcomputer Package for Two-Group Mathematical Programming-Based Nonparametric Classification,” . European Journal of Operational Research , 86 : 374 – 388 .
   Web of Science ®Google Scholar
• Van Ness , J. W. 1979 . “On the Effects of Dimension in Discriminant Analysis for Unequal Covariance Populations,” . Technometrics , 21 : 119 – 127 .
   Web of Science ®Google Scholar
• Wahl , P. W. and Kronmal , R. A. 1977 . “Discriminant Functions when Covariances are Unequal and Sample Sizes are Moderate,” . Biometrics , 33 : 479 – 484 .
   Web of Science ®Google Scholar
• Wald , A. 1944 . “On a Statistical Problem Arising in the Classification of an Individual Into One of Two Groups,” . Annals of Mathematical Statistics , 15 : 145 – 162 .
   Google Scholar
• Warmack , R. E. and Gonzalez , R. C. 1973 . “An Algorithm for the Optimal Solution of Linear Inequalities and its Application to Pattern Recognition,” . IEEE Transactions on Computers , C-22 : 1065 – 1075 .
   Google Scholar
• Welch , B. L. 1939 . “Note on Discriminant Functions,” . Biometrika , 31 : 218 – 220 .
   Web of Science ®Google Scholar