Improved model identification for non-linear systems using a random subsampling and multifold modelling (RSMM) approach

References

• Aguirre , LA and Billings , SA . 1994 . Validating Identified Nonlinear Models with Chaotic Dynamics . International Journal of Bifurcation and Chaos , 4 : 109 – 125 .
   Web of Science ®Google Scholar
• Aguirre , LA and Billings , SA . 1995a . Retrieving Dynamical Invariants from Chaotic Data Using Narmax Models . International Journal of Bifurcation and Chaos , 5 : 449 – 474 .
   Web of Science ®Google Scholar
• Aguirre , LA and Billings , SA . 1995b . Improved Structure Selection for Nonlinear Models Based on Term Clustering . International Journal of Control , 62 : 569 – 587 .
   Web of Science ®Google Scholar
• Akaike , H . 1974 . A New Look at the Statistical Model Identification . IEEE Transactions on Automatic Control , 19 : 716 – 723 .
   Web of Science ®Google Scholar
• Allen , DM . 1974 . The Relationship Between Variable Selection and Data Augmentation and a Method for Prediction . Technometrics , 16 : 125 – 127 .
   Web of Science ®Google Scholar
• Billings , SA and Chen , S . 1989 . Identification of Nonlinear Rational Systems Using a Prediction Error Estimation Algorithm . International Journal of Systems Science , 20 : 467 – 494 .
   Web of Science ®Google Scholar
• Billings , SA , Chen , S and Backhouse , RJ . 1989a . The Identification of Linear and Non-linear Models of a Turbo Charged Diesel-Engine . Mechanical Systems and Signal Processing , 3 : 123 – 142 .
   Web of Science ®Google Scholar
• Billings , SA , Chen , S and Korenberg , MJ . 1989b . Identification of MIMO Non-linear Systems Using a Forward-Regression Orthogonal Estimator . International Journal of Control , 49 : 2157 – 2189 .
   Web of Science ®Google Scholar
• Billings , SA and Zhu , QM . 1994 . A Structure Detection Algorithm for Nonlinear Dynamical Rational Models . International Journal of Control , 59 : 1439 – 1463 .
   Web of Science ®Google Scholar
• Billings , SA and Wei , HL . 2005a . A New Class of Wavelet Networks for Nonlinear System Identification . IEEE Transactions of Neural Networks , 16 : 862 – 874 .
   PubMed Web of Science ®Google Scholar
• Billings , SA and Wei , HL . 2005b . The Wavelet-NARMAX Representation: A Hybrid Model Structure Combining Polynomial Models and Multiresolution Wavelet Decompositions . International Journal of Systems Science , 36 : 137 – 152 .
   Web of Science ®Google Scholar
• Billings , SA , Wei , HL and Balikhin , MA . 2007 . Generalized Multiscale Radial Basis Function Networks . Neural Networks , 20 : 1081 – 1094 .
   PubMed Web of Science ®Google Scholar
• Billings , SA and Wei , HL . ‘An Adaptive Orthogonal Search Algorithm for Model Subset Selection and Nonlinear System Identification,’ . International Journal of Control , 81 714 – 724 .
   Web of Science ®Google Scholar
• Breiman , L . 1996 . Heuristics of Instability and Stabilization in Model Selection . Annals of Statistics , 24 : 2350 – 2383 .
   Web of Science ®Google Scholar
• Breiman , L and Spector , P . 1992 . Submodel Selection and Evaluation in Regression—The X-Random Case . International Statistical Review , 60 : 291 – 319 .
   Web of Science ®Google Scholar
• Brown , M and Harris , CJ . 1994 . Neurofuzzy Adaptive Modeling and Control , Hemel Hempstead : Prentice Hall .
   Google Scholar
• Chen , S , Billings , SA and Luo , W . 1989 . Orthogonal Least Squares Methods and their Application to Nonlinear System Identification . International Journal of Control , 50 : 1873 – 1896 .
   Web of Science ®Google Scholar
• Chen , S , Grant , PM and Cowan , CFN . 1992 . Orthogonal Least-Squares Algorithm for Training Radial Basis Function Networks . Proceedings of the Institute of Electrical and Electronics Engineers—Radar and Signal Process., pt. F , 139 : 378 – 384 . DOI: 10.1080/00207170701216311 (online)
   Google Scholar
• Chen , S , Chng , ES and Alkadhimi , K . 1996 . Regularized Orthogonal Least Squares Algorithm for Constructing Radial Basis Function Networks . International Journal of Control , 64 : 829 – 837 .
   Web of Science ®Google Scholar
• Chen , S , Hong , X , Harris , CJ and Sharkey , PM . 2004 . Sparse Modeling Using Orthogonal Regression with PRESS Statistic and Regularization . IEEE Transactions on Systems Man and Cybernetics B , 34 : 898 – 911 .
   PubMed Web of Science ®Google Scholar
• Cherkassky , V and Mulier , F . 1998 . Learning from Data , New York : Wiley .
   Google Scholar
• Correa , MV , Aguirre , LA and Mendes , EMAM . 2000 . Modelling Chaotic Dynamics with Discrete Nonlinear Rational Models . International Journal of Bifurcation and Chaos , 10 : 1019 – 1032 .
   Web of Science ®Google Scholar
• Devijver , PA and Kittler , J . 1982 . Pattern Recognition: A Statistical Approach , London : Prentice-Hall .
   Google Scholar
• Efron , B . 1983 . Estimating the Error Rate of a Prediction Rule: Improvements on Cross-Validation . Journal of the American Statistical Associations , 78 : 316 – 331 .
   Web of Science ®Google Scholar
• Efron , B and Gong , G . 1983 . A Leisurely Look at the Bootstrap, The Jackknife, and Cross-Validation . American Statistician , 37 : 36 – 48 . DOI: 10.1080/00207170701216311 (online)
   Web of Science ®Google Scholar
• Efron , B and Tibshirani , RJ . 1993 . An Introduction to the Bootstrap , New York : Chapman & Hall .
   Google Scholar
• Golub , GH , Heath , M and Wahha , G . 1979 . Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter . Technometrics , 21 : 215 – 223 .
   Web of Science ®Google Scholar
• Hansen , LK and Larsen , J . 1996 . Linear Unlearning for Cross-Validation . Advances in Computational Mathematics , 5 : 269 – 280 . DOI: 10.1080/00207170701216311 (online)
   Web of Science ®Google Scholar
• Hansen , MH and Yu , B . 2001 . Model Selection and the Principle of Minimum Description Length . Journal of the American Statistical Association , 96 : 746 – 774 .
   Web of Science ®Google Scholar
• Harris , CJ , Hong , X and Gan , Q . 2002 . Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach , Berlin, London : Springer-Verlag .
   Google Scholar
• Hoerl , AE and Kennard , RW . 1970a . Ridge Regression: Biased Estimation for Nonorthogonal Problems . Technometrics , 12 : 55 – 67 .
   Web of Science ®Google Scholar
• Hoerl , AE and Kennard , RW . 1970b . Ridge Regression: Application to Nonorthogonal Problems . Technometrics , 12 : 69 – 82 .
   Web of Science ®Google Scholar
• Hoerl , AE and Kennard , RW . 1976 . Ridge Regression Iterative Estimation of Biasing Parameter . Communication and Statistical—Theory of Methods , 5 : 77 – 88 . DOI: 10.1080/00207170701216311 (online)
   Web of Science ®Google Scholar
• Hong , X , Sharkey , PM and Warwick , K . 2003a . A Robust Non-linear Identification Algorithm Using PRESS Statistic and Forward Regression . IEEE Transactions of Neural Networks , 14 : 454 – 458 .
   PubMed Web of Science ®Google Scholar
• Hong , X , Sharkey , PM and Warwick , K . 2003b . Automatic Non-linear Predictive Model Construction Algorithm using Forward Regression and the PRESS Statistic . IEE Proceedings: Control Theory and its Applications , 150 : 245 – 254 . DOI: 10.1080/00207170701216311 (online)
   Google Scholar
• Hong , X , Harris , CJ , Chen , S and Sharkey , PM . 2003c . Robust Non-linear System Identification Methods using Forward Regression . IEEE Transactions on Systems, Man and Cybernetics – Part A , 33 : 514 – 523 .
   PubMed Web of Science ®Google Scholar
• Hong , X and Mitchell , X . 2007 . Backward Elimination Model Construction for Regression and Classification Using Leave-one-out Criterion . International of Systems Sciences , 38 : 101 – 113 .
   Web of Science ®Google Scholar
• Hurvich , CM and Tsai , CL . 1989 . Regression and Time Series Model Selection in Small Samples . Biometrika , 76 : 297 – 307 .
   Web of Science ®Google Scholar
• Leontaritis , IJ and Billings , SA . 1985 . Input–Output Parametric Models for Non-linear Systems, Part I: Deterministic Non-linear Systems . International Journal of Control , 41 : 303 – 344 .
   Web of Science ®Google Scholar
• Leontaritis , IJ and Billings , SA . 1987 . Experimental Design and Identifiability for Nonlinear Systems . International Journal of Systems Science , 18 : 189 – 202 .
   Web of Science ®Google Scholar
• Liu , GP . 2001 . Nonlinear Identification and Control: A Neural Network Approach , London : Springer .
   Google Scholar
• Ljung , L . 1987 . System Identification: Theory for the User , Englewood Cliffs : Prentice-Hall .
   Google Scholar
• Ljung , L . ‘Black-box Models from Input-Output Measurements,’ . Proceedings of 18th IEEE Instrumentation and Measurement Technology Conference (IMTC’2001) . Vol. 1 , May 21–23 . pp. 138 – 146 . Budapest, Hungary
   Google Scholar
• Miller , AJ . 1990 . Subset Selection in Regression , London : Chapman and Hall .
   Google Scholar
• Monari , G and Dreyfus , G . 2002 . Local Overfitting Control via Leverages . Neural Computers , 14 : 1481 – 1506 .
   PubMed Web of Science ®Google Scholar
• Montgomery , DC , Peck , EA and Vining , GG . 2001 . Introduction to Linear Regression Analysis , 3rd , New York : John Wiley & Sons .
   Google Scholar
• Murray-Smith , R and Johansen , TA . 1997 . Multiple Model Approaches to Modeling and Control , London : Taylor and Francis .
   Google Scholar
• Myles , AJ , Murray , AF , Wallace , AR , Barnard , J and Smith , G . 1997 . Estimating MLP Generalisation Ability Without a Test Set Using Fast, Approximate Leave-one-out cross-validation . Neural Computing and Applications , 5 : 134 – 151 .
   Web of Science ®Google Scholar
• Pearson , RK . 1995 . Nonlinear Input/Output Modelling . Journal of Process Control , 5 : 197 – 211 .
   Web of Science ®Google Scholar
• Pearson , RK . 1999 . Discrete-Time Dynamic Models , New York : Oxford University Press .
   Google Scholar
• Rissanen , J . 1978 . Modelling by Shortest Data Description . Automatica , 14 : 465 – 471 .
   Web of Science ®Google Scholar
• Schwarz , G . 1978 . Estimating the Dimension of a Model . The Annals of Statistics , 6 : 461 – 464 .
   Web of Science ®Google Scholar
• Shao , J . 1993 . Linear-model Selection by Cross-Validation . Journal of the American Statistical Association , 88 : 486 – 494 .
   Web of Science ®Google Scholar
• Shao , J . 1997 . An Asymptotic Theory for Linear Model Selection . Statistica Sinica , 7 : 221 – 242 .
   Web of Science ®Google Scholar
• Shao , J and Tu , D . 1995 . The Jackknife and Bootstrap , New York : Springer-Verlag .
   Google Scholar
• Stoica , P , Eykhoff , P , Janssen , P and Soderstrom , T . 1986 . Model-structure Selection by Cross-Validation . International Journal of Control , 43 : 1841 – 1878 .
   Web of Science ®Google Scholar
• Stoica , P and Selen , Y . 2004 . Model-order Selection: A Review of Information Criterion Rules . IEEE Signal Proceedings Magazine , 21 : 36 – 47 .
   Web of Science ®Google Scholar
• Stone , M . 1974 . Cross-Validatory Choice and Assessment of Statistical Predictions . Journal of the Royal Statistical Society Series B—Statistical Methodology , 36 : 111 – 147 . DOI: 10.1080/00207170701216311 (online)
   Web of Science ®Google Scholar
• Tsang , KM and Chan , WL . 2006 . A Search Algorithm for the Identification of Multiple Inputs Nonlinear Systems using Orthogonal Least Squares Estimator . Electrical Engineering , 88 : 357 – 365 .
   Web of Science ®Google Scholar
• Truong , NV , Wang , L and Young , PC . 2007 . Non-linear System Modelling Based on Non-parametric Identification and Linear Wavelet Estimation of SDP Models . International Journal of Control , 80 : 774 – 788 .
   Web of Science ®Google Scholar
• Wei , HL , Billings , SA and Liu , J . 2004 . Term and Variable Selection for Nonlinear System Identification . International Journal of Control , 77 : 86 – 110 .
   Web of Science ®Google Scholar
• Wei , HL and Billings , SA . 2004 . A Unified Wavelet-Based Modelling Framework for Nonlinear System Identification: The WANARX Model Structure . International Journal of Control , 77 : 351 – 366 .
   Web of Science ®Google Scholar
• Wei , HL and Billings , SA . 2006 . An Efficient Nonlinear Cardinal B-spline Model for High Tide Forecasts at the Venice Lagoon . Nonlinear Processes in Geophysics , 13 : 577 – 584 .
   Web of Science ®Google Scholar
• Wei , HL , Zhu , DQ , Billings , SA and Balikhin , MA . 2007 . Forecasting the Geomagnetic Activity of the Dst Index using Multiscale Radial Basis Function Networks . Advances in Space Research , 40 : 1863 – 1870 .
   Web of Science ®Google Scholar
• Zhu , QM and Billings , SA . 1993 . Parameter-Estimation for Stochastic Nonlinear Rational Models . International Journal of Control , 57 : 309 – 333 .
   Web of Science ®Google Scholar
• Zhu , QM and Billings , SA . 1996 . Fast Orthogonal Identification of Nonlinear Stochastic Models and Radial Basis Function Networks . International Journal of Control , 64 : 871 – 886 .
   Web of Science ®Google Scholar