Model selection approaches for non-linear system identification: a review

References

• Adeney , KM and Korenberg , MJ . 2000 . Iterative Fast Orthogonal Search Algorithm for MDL-based Training of Generalised Single-layer Network . Neural Networks , 13 : 787 – 799 .
   PubMed Web of Science ®Google Scholar
• Aguirre , LA , Coelho , MCS and Correa , MV . 2005 . On the Interpretation and Practice of Dynamical Differences Between Hammerstein and Wiener Models . IEE Proc. and Control Theory Applications , 152 ( 4 ) : 349 – 356 .
   Web of Science ®Google Scholar
• Aguirre , LA , Donoso-Garcia , PF and Santos-Filho , R . 2000 . Use of a Priori Information in the Identification of Global Nonlinear Models-a Case Study using a Buck Converter . IEEE Transactions on Circuits and Systems-I: Fundamental Theory and Applications , 47 ( 7 ) : 1081 – 1085 .
   Google Scholar
• Aguirre , LA , Lopes , RAM , Amaral , GFV and Letellier , C . 2004 . Constraining the topology of Neural Networks to Ensure Dynamics with Symmetry Properties . Physical Review E , 69 : 026701–1 – 026701–11 .
   Web of Science ®Google Scholar
• Akaike , H . 1974 . A New Look at the Statistical Model Identification . IEEE Transactions on Automatic Control , AC-19 : 716 – 723 .
   Web of Science ®Google Scholar
• Allen , DM . 1974 . The Relationship Between Variable Selection and Data Augumentation and a Method for Prediction . Technometrics , 16 : 125 – 127 .
   Web of Science ®Google Scholar
• Altinkok , N . 2006 . Use of Artificial Neural Network for Prediction of Mechanical Properties of α-Al 2 O 3 Particulate-reinforced alsi10mg Alloy Composites Prepared by using Stir Casting Process . Journal of Composite Materials , 40 ( 9 ) : 779 – 796 .
   Web of Science ®Google Scholar
• Aronszajin , N . 1950 . Theory of Reproducing Kernels . Transactions on American Mathematical Society , 68 : 337 – 404 .
   Web of Science ®Google Scholar
• Aström , KJ and Eyhhoff , P . 1971 . System Identification  – a Survey . Automatica , 7 : 123 – 162 .
   Web of Science ®Google Scholar
• Aström , KJ and Wittenmark , B . 1989 . Adaptive Control , MS : Addison Wesley .
   Google Scholar
• Atkinson , AC and Donev , AN . 1992 . Optimum Experimental Designs , Oxford : Clarendon Press .
   Google Scholar
• Bai , EW . 1998 . An Optimal Two-stage Identification Algorithm for Hammerstein-wiener Nonlinear Systems . Automatica , 34 : 333 – 338 .
   Web of Science ®Google Scholar
• Bai , EW . 2004 . Decoupling the Linear and Nonlinear Parts in Hammerstein Model Identification . Automatica , 40 : 671 – 676 .
   Web of Science ®Google Scholar
• Barron , AR . 1984 . “ Predicted Square Error. A Criterion for Automatic Model Selection ” . In SelfOrganizing Methods in Modeling , Edited by: Farlow , S . Cambridge, MA : MIT Press .
   Google Scholar
• Bartlett , PL . 2003 . “ Reproducing Kernel Hilbert Spaces ” . In Lecture Notes, CS281B/Stat241B, Statistical Learning Theory , Berkeley, , USA : The Computer Science Division, University of California .
   Google Scholar
• Basso , M , Giarre , L , Groppi , S and Zappa , G . 2005 . NaRX Models of an Industrial Power Plant Gas Turbine . IEEE Transactions on Control Systems Technology , 13 ( 4 ) : 599 – 604 .
   Web of Science ®Google Scholar
• Battiti , R . 1994 . Using Mutual Information for Selecting Features in Supervised Neural Net Learning . IEEE Transactions on Neural Networks , 5 ( 4 ) : 537 – 550 .
   PubMed Web of Science ®Google Scholar
• Billings , SA and Wei , HL . 2005 . The Wavelet-narmax Representation: A Hybrid Model Structure Combining Polynomial Models with Multiresolution Wavelet Decompositions . International Journal of Systems Science , 36 ( 3 ) : 137 – 152 .
   Web of Science ®Google Scholar
• Billings , SA and Voon , WSF . 1987 . Piecewise Linear Identification of Nonlinear Systems . International Journal of Control , 46 : 215 – 235 .
   Web of Science ®Google Scholar
• Billings , SA , Chen , S and Backhouse , RJ . 1989 . The Identification of Linear and Nonlinear Models of a Turbocharged Automative Diesel Engine . Mechanical Systems and Signal Processings , 3 ( 2 ) : 123 – 142 .
   Web of Science ®Google Scholar
• Bohlin , T . 1971 . On the Problem of Ambiguities in Maximum Likelihood Identification . Automatica , 7 : 199 – 200 .
   Web of Science ®Google Scholar
• Bohlin , T . 2006 . Practical Grey-box Process Identification: Theory and Applications , New York : Springer .
   Google Scholar
• Bossley , KM . 1997 . “ Neurofuzzy Modelling Approaches in System Identification ” . In , Ph.D. thesis , Dept. of ECS University of Southampton .
   Google Scholar
• Bowden , GJ , Dandy , GC and Maier , HR . 2005 . Input Determination for Neural Network Models in Water Resources Applications. Part 1-background and Methodology . Journal of Hydrology , 301 : 75 – 92 .
   Web of Science ®Google Scholar
• Box , GEP and Jenkins , GM . 1976 . Time Series Analysis: Forecasting and Control , San Francisco : Holden-Day Inc .
   Google Scholar
• Bradford , JR and Westhead , DR . 2005 . Improved Prediction of Protein-protein Binding Sites using a Support Vector Machines Approach . Bioinformatics , 21 ( 8 ) : 1487 – 1494 .
   PubMed Web of Science ®Google Scholar
• Broomhead , DS and Lowe , D . 1988 . Multivariable Functional Interpolation and Adaptive Networks . Complex Systems , 2 : 321 – 355 .
   Google Scholar
• Brown , M and Harris , CJ . 1994 . Neurofuzzy Adaptive Modelling and Control , Hemel Hempstead : Prentice Hall .
   Google Scholar
• Brown , MD , Flynn , D and Irwin , GW . 2002 . Multiple Model Nonlinear Control of Synchronous Generators . Transactions on Inst MC, Special Issue on Electrical Power Generation , 24 ( 3 ) : 215 – 230 .
   Google Scholar
• Brown , MD , Irwin , GW and Lightbody , G . 1997 . “ Nonlinear Internal Model Control using Local Model Networks with Application to a pH Process ” . In Proc. IFAC nt. Symp. on Advanced Control of Chemical Processes, AdChem 97 , 13 – 18 . Canada : Banff .
   Google Scholar
• Burges , CJ . 1996 . “ Simplified Support Vector Decision Rules ” . In Proc. International Conference on Machine Learning 71 – 77 .
   Google Scholar
• Chen , S . 2002 . “ Locally Regularised Orthogonal Least Squares Algorithm for the Construction of Sparse Kernel Regression Models ” . In Proceedings of 6th Int. Cof. Signal Processing , 1229 – 1232 . China : Beijing .
   Google Scholar
• Chen , S , Billings , SA and Luo , W . 1989 . Orthogonal Least Squares Methods and their Applications to Non-linear System Identification . International Journal of Control , 50 : 1873 – 1896 .
   Web of Science ®Google Scholar
• Chen , SS , Donoho , DL and Saunders , MA . 1998 . Atomic Decomposition by Basis Pursuit . SIAM Journal on Scientific Computing , 20 ( 1 ) : 33 – 61 .
   Web of Science ®Google Scholar
• Chen , S , Hong , X and Harris , CJ . 2003b . Sparse Multioutput Radial Basis Function Network Construction using Combined Locally Regularised Orthogonal Least Square and D-optimality Experimental Design . IEE Proceedings Control Theory and Applications , 150 ( 2 ) : 139 – 146 .
   Google Scholar
• Chen , S , Hong , X and Harris , CJ . 2003a . Sparse Kernel Regression Modelling using Combined Locally Regularised Orthogonal Least Squares and D-optimality Experimental Design . IEEE Transactions on Automatic Control , 48 ( 6 ) : 1029 – 1036 .
   Web of Science ®Google Scholar
• Chen , S , Hong , X and Harris , CJ . 2005a . “ Orthogonal forward Selection for Constructing the Radial Basis Function Network with Tunable Nodes ” . In Proceedings of 2005 Int. Conf. Intelligent Computing 777 – 786 . Hefei, China
   Google Scholar
• Chen , S , Wu , Y and Luk , BL . 1999 . Combined Genetic Algorithm Optimization and Regularized Orthogonal Least Squares Learning for Radial Basis Function Networks . IEEE Transactions on Neural Networks , 10 : 1239 – 1243 .
   PubMed Web of Science ®Google Scholar
• Chen , S , Gibson , GJ , Cowan , CF and Grant , PM . 1991 . Reconstruction of Binary Signals using an Adaptive Radial-basis-function Equalizer . Signal Processing , 20 ( 1 ) : 77 – 93 .
   Web of Science ®Google Scholar
• Chen , S , Hong , X , Harris , CJ and Sharkey , PM . 2004 . Sparse Modelling using Orthogonal forward Regression with PRESS Statistic and Regularization . IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics , 34 ( 2 ) : 898 – 911 .
   PubMed Web of Science ®Google Scholar
• Chen , S , Hong , X , Wang , XX and Harris , CJ . 2005b . Identification of Nonlinear Systems using Generalised Kernel Models . IEEE Transactions on Control Systems Technology , 13 ( 3 ) : 401 – 411 .
   Web of Science ®Google Scholar
• Chen , S , Wolfgang , A , Harris , CJ and Hanzo , L . 2007 . “ Symmetric Kernel Detector for Multiple-antenna Aided Beamforming Systems ” . In 2007 International Joint Conference on Neural Networks (IJCNN)
   Google Scholar
• Chiras , N , Evans , C and Rees , D . 2001 . Nonlinear Gas Turbine Modelling using Narmax Structures . IEEE Transactions on Instrumentation and Measurement , 50 ( 4 ) : 893 – 898 .
   Web of Science ®Google Scholar
• Clarkson , T . 1999 . “ Applications of Neural Networks in Telecommunications ” . In Proceedings of the ERUDIT Workshop on Application of Computational Intelligence Techniques in Telecommunication , London : Imperial College .
   Google Scholar
• Cohn , DA , Ghahramani , Z and Jordan , MI . 1996 . Active Learning with Statistical Models . Journal of Artificial Intelligence Research , 4 : 129 – 145 .
   Web of Science ®Google Scholar
• Connally , P , Li , K and Irwin , GW . 2005 . Two Applications of Eng-genes Bases Nonlinear Identification . Proceedings of the 16th IFAC World Congress . 2005 , Prague.
   Google Scholar
• Connally , P , Li , K and Irwin , GW . 2007 . “ Integrated Structure Selection and Parameter Optimisation for Eng-genes Neural Models ” . In Neurocomputing (in press) doi:10.1016/j.neucom.2007.06.005
   Google Scholar
• Cybenko , G . 1989 . Approximations by Superpositions of Sigmoidal Functions . Mathematics of Control, Signals, and Systems , 2 : 303 – 314 .
   Google Scholar
• Daubechies , I . 1992 . Ten Lectures on Wavelets , Philadelphia, PA : SIAM .
   Google Scholar
• Debnath , L and Mikusinski , P . 1998 . Introduction to Hilbert Spaces with Applications , San Diego, CA : Academic Press .
   Google Scholar
• Donoho , DL . 1995 . De-noising by Soft-thresholding . IEEE Transactions on Information Theory , 41 ( 3 ) : 613 – 627 .
   Web of Science ®Google Scholar
• Downs , T , Gates , K and Masters , A . 2001 . Exact Simplification of Support Vector Solutions . Journal of Machine Learning Research , 2 : 293 – 297 .
   Web of Science ®Google Scholar
• Drezet , PML and Harrison , RF . 1998 . “ Support Vector Machines for System Identification ” . In Proceedings of UKACC International Conference on Control, Vol. 1 , 688 – 692 . UK : Swansea .
   Google Scholar
• Dybowski , R and Gant , V . 2001 . Clinical Applications of Artificial Neural Networks , Cambridge : Cambridge University Press .
   Google Scholar
• Engel , Y , Mannor , S and Meir , R . 2004 . The Kernel Recursive Least Squares Algorithm . IEEE Transactions on Signal Processing , 52 ( 8 ) : 2275 – 2285 .
   Web of Science ®Google Scholar
• Espinoza , M , Suykens , JAK and De Moor , B . 2005a . “ Imposing Symmetry in Least Squares Support Vector Machines Regression ” . In Proc. Joint 44th IEEE Conf. Decision and Control and European Control Conf. 2005 5716 – 5721 . Seville, , Spain
   Google Scholar
• Espinoza , M , Suykens , JAK and De Moor , B . 2005b . Kernel Based Partially Linear Models and Nonlinear Identification . IEEE Transactions on Automatic Control , 50 ( 10 ) : 1602 – 1606 .
   Web of Science ®Google Scholar
• Evgeniou , T , Pontil , M and Poggio , T . 2000 . Regularization Networks and Support Vector Machine . Advances in Computational Mathematics , 13 ( 1 ) : 1 – 50 .
   Web of Science ®Google Scholar
• Eykhoff , P . 1974 . System Identification  – Parameter and State Estimation , Chichester : J. Wiley .
   Google Scholar
• Fabri , SG and Kadirkamanathan , V . 2001 . Functional Adaptive Control: An Intelligent Systems Approach , London, Berlin, Heidelberg : Springer .
   Google Scholar
• Faller , WE and Schreck , SJ . 1996 . Neural Networks: Applications and Opportunities in Aeronautics . Progress in Aerospace Sciences , 32 ( 5 ) : 433 – 456 .
   Web of Science ®Google Scholar
• Flood , I and Kartam , N . 1998 . “ Artificial Neural Networks for Civil Engineers: Advanced Features and Applications ” . In Handbook of Intelligent Control , Reston, VA : American Society of Civil Engineers .
   Google Scholar
• Friedman , JH . 1991 . Multivariate Adaptive Regression Splines . The Annals of Statistics , 19 ( 1 ) : 1 – 141 .
   Web of Science ®Google Scholar
• Friedman , JH and Stuetzle , W . 1981 . Projection Pursuit Regression . Journal of the American Statistical Association , 76 ( 376 ) : 817 – 823 .
   Web of Science ®Google Scholar
• Funahashi , K . 1989 . On the Approximate Realization of Continuous Mapping by Neural Networks . Neural Networks , 2 : 183 – 192 .
   Web of Science ®Google Scholar
• Gamero , LG , Armentano , RL , Barra , JG , Simon , A and Levenson , J . 2001 . Identification of Arterial Wall Dynamics in Conscious Dogs . Experimental Physiology , 86 : 519 – 528 .
   PubMed Web of Science ®Google Scholar
• Gao , Y and Er , MJ . 2003 . Online Adaptive Fuzzy Neural Identification and Control of a Class of Mimo Nonlinear Systems . IEEE Transactions on Fuzzy Systems , 11 ( 4 ) : 462 – 477 .
   Web of Science ®Google Scholar
• Gao , JB , Harris , CJ and Gunn , SR . 2001 . On a Class of Support Vector Kernels Based on Frames in Function Hilbert Spaces . Neural Computations , 13 : 1975 – 1994 .
   PubMed Web of Science ®Google Scholar
• Garson , GD . 1991 . A Comparison of Neural Network and Expert Systems Algorithms with Common Multivariate Procedures for analysis of Social Science Data . Social Science Computer Review , 9 ( 3 ) : 399 – 434 .
   Google Scholar
• Ge , SS , Hang , CC , Lee , TH and Zhang , T . 2001 . Stable Adaptive Neural Network Control , Boston, MA : Kluwer Academic .
   Google Scholar
• Geman , S , Bienenstock , E and Doursat , R . 1992 . Neural Networks and the Bias/VAriance Dilemma . Neural Computation , 4 : 1 – 58 .
   Web of Science ®Google Scholar
• Gevers , M . 2005 . Identification for Control: From the Early Achievements to the Revival of Experiment Design . European Journal of Control , 11 : 1 – 18 .
   Web of Science ®Google Scholar
• Girosi , F . 1998 . An Equivalence Between Sparse Approximation and Support Vector Machines . Neural Computation , 10 ( 6 ) : 1455 – 1480 .
   PubMed Web of Science ®Google Scholar
• Girosi , F and Poggio , T . 1990 . Networks and the Best Approximation Property . Biological Cybernetics , 63 : 169 – 176 .
   Web of Science ®Google Scholar
• Glass , JW and Franchek , MA . 1999 . NaRMAX Modelling and Robust Control of Internal Combustion Engines . International Journal of Control , 72 ( 4 ) : 289 – 304 .
   Web of Science ®Google Scholar
• Goethals , I , Pelckmans , K , Suykens , JAK and De Moor , B . 2005 . Identification of MIMO Hammerstein Models using Least Squares Support Vector Machines . Automatica , 41 : 1263 – 1272 .
   Web of Science ®Google Scholar
• Goethals , I , Van Gestel , T , Suykens , J , Van Dooren , P and De Moor , B . 2003 . Identification of Positive Real Models in Subspace Identification by using Regularization . IEEE Transactions on Automatic Control , 48 ( 10 ) : 1843 – 1847 .
   Web of Science ®Google Scholar
• Goodwin , GC and Sin , KS . 1984 . Adaptive Filtering Prediction and Control , Englewood Cliffs, NJ : Prentice Hall .
   Google Scholar
• Govindhasamy , JJ , McLoone , SF , Irwin , GW , French , JJ and Doyle , R . 2005 . Neural Modelling, Control and Optimisation of an industrial Grinding Process . Control Engineering Practice , 13 ( 10 ) : 1243 – 1258 .
   Web of Science ®Google Scholar
• Gray , GJ , Murray-Smith , DJ , Li , Y and Sharman , KC . 1996 . “ Nonlinear Model Structure Identification using Genetic Programming ” . In Late Breaking Papers at the Genetic Programming 1996 Conference Stanford University July 28–31, 1996 , Edited by: Koza , John R . 32 – 37 . CA, , USA : Stanford Bookstore, Stanford University .
   Google Scholar
• Greblicki , W . 1989 . Nonparametric Orthogonal Series Identification of Hammerstein Systems . International Journal of Systems Science , 20 : 2355 – 2367 .
   Web of Science ®Google Scholar
• Green , PJ and Silverman , BW . 1994 . Nonparametric Regression and Generalized Linear Models , London : Chapman and Hall .
   Google Scholar
• Harris , CJ , Hong , X and Gan , Q . 2002 . Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach , Heidelberg : Springer-Verlag .
   Google Scholar
• Harrison , RF and Kennedy , RL . 2005 . Artificial Neural Network Models for Prediction of Acute Coronary Syndromes using Clinical Data from the Time of Presentation . Annals of Emergency Medicine , 46 : 431 – 439 .
   PubMed Web of Science ®Google Scholar
• Hastie , TJ and Tibshirani , RJ . 1996 . Generalised Additive Models , London : Chapman and Hall .
   Google Scholar
• Hastie , TJ , Tibshirani , RJ and Friedman , J . 2002 . The Elements of Statistical Learning: Data Mining, Inference, and Prediction , New York : Springer .
   Google Scholar
• Hoegaerts , L , Suykens , JAK , Vandewalle , J and De Moor , B . 2005 . Subset Based Least Squares Subspace Regression in Rkhs . Neurocomputing , 63 : 293 – 323 .
   Web of Science ®Google Scholar
• Hoerl , AE and Kennard , RW . 1970 . Ridge Regression: Biased Estimation for Nonorthogonal Problems . Technometrics , 12 ( 1 ) : 55 – 67 .
   Web of Science ®Google Scholar
• Hong , WC . 2006 . The Application of Support Vector Machines to forecast tourist Arrivals in Barbados: An Empirical Study . International Journal of Management , 23 ( 2 ) : 375 – 385 .
   Google Scholar
• Hong , X and Chen , S . 2005 . M-estimator and D-Optimality Model Construction using Orthogonal Forward Regression . IEEE Transactions on System, Man, and Cybernetics, Part B , 35 ( 1 ) : 155 – 162 .
   PubMed Web of Science ®Google Scholar
• Hong , X and Harris , CJ . 2001a . Neurofuzzy Design and Model Construction of Nonlinear Dynamical Processes from Data . IEE Proceedings Control Theory and Applications , 148 ( 6 ) : 530 – 538 .
   Google Scholar
• Hong , X and Harris , CJ . 2001b . Variable Selection Algorithm for the Construction of Mimo Operating Point Dependent Neurofuzzy Network . IEEE Transactions on Fuzzy Systems , 9 ( 1 ) : 88 – 101 .
   Web of Science ®Google Scholar
• Hong , X and Harris , CJ . 2003 . Experimental Design and Model Construction Algorithms for Radial Basis Function Networks . International Journal of Systems Science , 34 ( 14–15 ) : 733 – 745 .
   Web of Science ®Google Scholar
• Hong , X and Mitchell , RJ . 2007 . Backward Elimination Model Construction for Regression and Classification using Leave one Out Criteria . International Journal of Systems Science , 38 ( 2 ) : 101 – 113 .
   Web of Science ®Google Scholar
• Hong , X , Harris , CJ , Brown , M and Chen , S . 2004 . Backward Elimination Methods for Associative Memory Network Pruning . International Journal of Hybrid Intelligent Systems , 1 ( 1–2 ) : 90 – 98 .
   Google Scholar
• Hong , X , Sharkey , PM and Warwick , K . 2003 . Automatic Nonlinear Predictive Model Construction using forward Regression and the PRESS Statistic . IEE Proceedings and Control Theory Applications , 150 ( 3 ) : 245 – 254 .
   Google Scholar
• Hornik , K , Stinchcombe , M and White , H . 1989 . Multilayer Feedforward Networks are Universal Approximator . Neural Networks , 2 : 359 – 366 .
   Web of Science ®Google Scholar
• Huang , GB , Saratchandran , P and Sundararaja , N . 2004a . An Efficient Sequential Learning Algorithm for Growing and Pruning RBF (GAP-RBF)networks . IEEE Transactions on Systems, Man and Cybernetics, Part B , 34 ( 6 ) : 2284 – 2292 .
   PubMed Web of Science ®Google Scholar
• Huang , GB , Zhu , QY and Siew , CK . 2004b . “ Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks ” . In Proceedings of International Joint Conference on Neural Networks (IJCNN2004), Vol. 2 , 985 – 990 . Hungary : Budapest .
   Google Scholar
• Huang , SN , Tan , KK and Lee , TH . 2006 . Nonlinear Adaptive Control of interconnected Systems using Neural Networks . IEEE Transactions on Neural Network , 17 ( 1 ) : 243 – 246 .
   PubMed Web of Science ®Google Scholar
• Huber , PJ . 1981 . Robust Statistics , New Jersey : J. Wiley .
   Google Scholar
• Iplikci , S . 2006 . Support Vector Machines-based Generalized Predictive Control . International Journal of Robust and Non-Linear Control , 16 : 834 – 862 .
   Web of Science ®Google Scholar
• Irwin , GW , Warwick , K and Hunt , KJ . 1995 . Neural Network Applications in Control , London : IEE .
   Google Scholar
• James , W and Stein , C . 1961 . Estimation with Quadratic Loss . Proceedings Fourth Berkeley Symp. Math. Statist. Prob. , 1 : 311–319
   Google Scholar
• Juditsky , A , Hjalmarsson , H , Benveniste , A , Delyon , B , Ljung , L , Sjöberg , J and Zhang , Q . 1995 . Nonlinear Black-box Modelling in System Identification: Mathematical Foundations . Automatica , 31 ( 12 ) : 1725 – 1752 .
   Web of Science ®Google Scholar
• Jurado , F . 2004 . Experience with Non-linear Model Identification for Fuel Cell Plants . Fuel Cells , 5 : 105 – 114 .
   Web of Science ®Google Scholar
• Jurado , F . 2005 . Non-linear Modeling of Micro-turbines using NARX Structures on the Distribution Feeder . Energy Conversion and Management , 46 ( 3 ) : 385 – 401 .
   Web of Science ®Google Scholar
• Kadirkamanathan , V and Niranjan , M . 1993 . A Function Estimation Approach to Sequential Learning with Neural Networks . Neural Computation , 5 ( 6 ) : 954 – 975 .
   Web of Science ®Google Scholar
• Kalkkuhl , J , Hunt , KJ and Fritz , H . 1999 . Fem-based Neural-network Approach to Nonlinear Modeling with Application to Longitudinal Vehicle Dynamics Control . IEEE Transactions on Neural Networks , 10 ( 4 ) : 885 – 897 .
   PubMed Web of Science ®Google Scholar
• Kanevski , M , Parkin , R , Pozdnukhov , A , Timonin , V , Maignan , M , Yatsalo , B and Canu , S . 2004 . Environmental Data Mining and Modelling Based on Machine Learning Algorithms and Geostatistics . Journal of Environmental Modelling and Software , 19 : 845 – 855 .
   Web of Science ®Google Scholar
• Karayiannis , NB , Mukherjee , A , Glover , JR , Ktonas , PY , Frost , JD Jr , Hrachovy , RA and Mizrahi , EM . 2006 . Detection of Pseudosinusoidal Epileptic Seizure Segments in the Neonatal Eeg by Cascading a Rule-based Algorithm with a Neural Network . IEEE Transactions on Biomedical Engineering , 53 ( 4 ) : 633 – 641 .
   PubMed Web of Science ®Google Scholar
• Kavli , T . 1993 . AsMOD  – an Algorithm for Adaptive Spline Modelling of Observation Data . International Journal of Control , 58 ( 4 ) : 947 – 967 .
   Web of Science ®Google Scholar
• Khan , MS and Coulibaly , P . 2006 . Application of Support Vector Machine in Lake Water Level Prediction . Journal of Hydrologic Engineering , 11 ( 3 ) : 199 – 205 .
   Web of Science ®Google Scholar
• Knight , K and Fu , WJ . 2000 . Asymptotics for Lasso-type Estimators . Annals of Statistitics , 28 : 1356 – 1378 .
   Web of Science ®Google Scholar
• Korenberg , MJ . 1988 . Identifying Nonlinear Difference Equation and Functional Expansion Representations: The Fast Orthogonal Algorithm . Annals of Biomedical Engineering , 16 : 123 – 142 .
   PubMed Web of Science ®Google Scholar
• Kwak , N . 2002 . Input Feature Selection by Mutual Information Based on Parzen Window . IEEE Transactions on Pattern Analysis and Machine Intelligence , 24 ( 12 ) : 1667 – 1671 .
   Web of Science ®Google Scholar
• Lee , KL and Billings , SA . 2002 . Time Series Prediction using Support Vector Machines, the Orthogonal, and the Regularised Orthogonal Least Squares Algorithms . International Journal of Systems Science , 33 : 811 – 821 .
   Web of Science ®Google Scholar
• Leontaritis , IJ and Billings , SA . 1985 . Input-output Parametric Models for Nonlinear Systems  – Part 1: Deterministic Nonlinear Systems; Part 2: Stochastic Nonlinear Systems . International Journal of Control , 41 ( 1 ) : 303 – 344 .
   Web of Science ®Google Scholar
• Leung , H , Lo , T and Wang , S . 2001 . Prediction of Noisy Chaotic Time Series using an Optimal Radial Basis Function Neural Network . IEEE Transactions on Neural Networks , 12 ( 5 ) : 1163 – 1172 .
   PubMed Web of Science ®Google Scholar
• Leva , A and Piroddi , L . 2002 . Narx-based Technique for the Modelling of Magneto-rheological Damping Devices . Smart Materials Structures , 11 : 79 – 88 .
   Web of Science ®Google Scholar
• Lewis , FL and Parisini , T . 1998 . Guest Editorial: Neural Network Feedback with Guaranteed Stability . International Journal of Control , 70 ( 3 ) : 337 – 339 .
   Web of Science ®Google Scholar
• Li , K . 2005 . Eng-genes: A New Genetic Modelling Approach for Nonlinear Dynamic Systems . Proceedings of the 16th IFAC World Congress . 2005 , Prague.
   Google Scholar
• Li , K and Peng , JX . 2006 . System Oriented Neural Networks  – Problem formulation, Methodology and Application . International Journal of Pattern Recognition and Artificial Intelligence , 20 ( 2 ) : 143 – 158 .
   Web of Science ®Google Scholar
• Li , K , Peng , J and Bai , EW . 2006 . A Two-stage Algorithm for Identification of Nonlinear Dynamic Systems . Automatica , 42 ( 7 ) : 1189 – 1197 .
   Web of Science ®Google Scholar
• Li , K , Peng , JX and Irwin , GW . 2005 . A Fast Nonlinear Model Identification Method . IEEE Transactions on Automatic Control , 50 ( 8 ) : 1211 – 1216 .
   Web of Science ®Google Scholar
• Li , K , Thompson , S and Peng , J . 2004 . Modelling and Prediction of NOx Emission in a Coal-fired Power Generation Plant . Control Engineering Practice , 12 : 707 – 723 .
   Web of Science ®Google Scholar
• Lin , B , Lin , B , Chong , F and Lai , F . 2007 . Higher-order-Statistics-based Radial basis Function Networks for Signal Enhancement , 18 ( 3 ) : 823 – 832 .
   Google Scholar
• Liu , GP . 2001 . Nonlinear Identification and Control-A Neural Network Approach , London : Springer .
   Google Scholar
• Liu , GP , Kadirkamanathan , V and Billings , SA . 1999 . Variable Neural Networks for Adaptive Control of Nonliear Systems . IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics , 29 ( 1 ) : 34 – 43 .
   Web of Science ®Google Scholar
• Ljung , L . 1987 . System Identification: Theory for the User , New Jersey : Prentice Hall .
   Google Scholar
• Ljung , L and Vicino , A . 2005 . Special Issue on Identification . IEEE Transactions on Automatic Control , 50 ( 10 ) : 1477 – 1634 .
   Web of Science ®Google Scholar
• Ljung , L and Söderström , T . 1983 . Theory and Practice of Recersive Identification , Cambridge, MA : The MIT Press .
   Google Scholar
• Lorito , F . 1999 . Identification of a Grey-box Model of Nonlinear Current Transformers for Simulation Purposes . Control Engineering Practice , 6 ( 11 ) : 1331 – 1339 .
   Web of Science ®Google Scholar
• Luh , GC and Cheng , WC . 2004 . Identification of Immune Models for Fault Detection . Proceedings Instn Mech. Engrs Part I:J Systems and Control Engineering , 218 : 353 – 367 .
   Web of Science ®Google Scholar
• Luo , W , Morris , AJ , Karim , MN , Martin , EB and Hong , T . 1996 . Online Identification of a Ph Waste Water Neutralisation Process using Time-varying Nonlinear Arx Models . IEEE International Conference on Systems, Man, and Cybernetics, 1996 . 14–17 Oct. 1996 . Vol. 1 , pp. 107 – 112 .
   Google Scholar
• Ma , Q and Wang , J . 2000 . Application of Bayesian Neural Networks to Protein Sequence Classification . ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining . 2000 . pp. 305 – 309 .
   Google Scholar
• MacKay , DJC . 1991 . Bayesian Methods for Adaptive Models. PhD thesis , USA : California Institute of Technology .
   Google Scholar
• Mackay , DJ . 1997 . “ Gaussian Processes: A Replacement for Supervised Neural Networks ” . In Lecture notes at NIPS 1997 http://www.ra.phy.cam.ac.uk/mackay
   Google Scholar
• Mallat , SG . 1989 . A theory for Multiresolutional Signal Decomposition: The Wavelet Representation . IEEE Transactions on Pattern Analysis and Machine Intelligence , 11 : 674 – 693 .
   Web of Science ®Google Scholar
• Mallat , SG and Zhang , Z . 1993 . Matching Pursuits with Time-frequency Dictionaries . IEEE Transactions on Signal Processing , 41 ( 12 ) : 3397 – 3415 .
   Web of Science ®Google Scholar
• Mandic , DP and Chambers , JA . 2001 . Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures, and Stability , Chichester : J Wiley .
   Google Scholar
• Mao , KZ and Billings , SA . 1999 . Variable Selection in Nonlinear Systems Modelling . Mechanical Systems and Signal Processing , 13 ( 2 ) : 351 – 366 .
   Web of Science ®Google Scholar
• Mao , KZ and Billings , SA . 2000 . Multi-directional Model Validity Tests for Nonlinear System Identification . International Journal of Control , 73 : 132 – 143 .
   Web of Science ®Google Scholar
• Mao , KZ , Billings , SA and Zhu , QM . 1999 . A Regularised Least Squares Algorithm for Nonlinear Rational Model Identification . International Journal of Systems Science , 30 : 455 – 465 .
   Web of Science ®Google Scholar
• Markovsky , I , Willems , JC , Rapisarda , P and de Moor , BLM . 2005 . Algorithms for Deterministic Balanced Subspace Identification . Automatica , 41 : 755 – 766 .
   Web of Science ®Google Scholar
• Marose , RA . 1990 . A Financial Neural-network Application . AI Expert , 5 ( 5 ) : 50 – 53 .
   Google Scholar
• Marquardt , DW . 1970 . Generalised inverse, Ridge Regression, Biased Linear Estimation and Nonlinear Estimation . Technometrics , 12 ( 3 ) : 591 – 612 .
   Web of Science ®Google Scholar
• McGinnity , S and Irwin , GW . 1996 . Nonlinear State Estimation using Fuzzy Local Linear Models . International Journal of Systems Science , 28 ( 7 ) : 643 – 656 .
   Web of Science ®Google Scholar
• Mercer , J . 1909 . Functions of Positive and Negative Type and their Connection with the Theory of Integral Equations . Philos. Transactions on Roy. Soc. London , A 209 : 415 – 446 .
   Google Scholar
• Miller , AJ . 1990 . Subset Selection in Regression , Boca Raton, Florida : Chapman and Hall/CRC .
   Google Scholar
• Minoux , M . 1986 . Mathematical Programming: Theory and Algorithms , New York : Wiley .
   Google Scholar
• Mitra , S and Hayashi , Y . 2006 . Bioinformatics with Soft Computing . IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews , 36 ( 5 ) : 616 – 635 .
   Web of Science ®Google Scholar
• Moody , J . 1994 . “ Prediction Risk and Architecture Selection for Neural Networks ” . In From Statistics to Neural Networks: Theory and Pattern Recognition Applications , Edited by: Cherkassky , V . Berlin, New York : Springer-Verlag .
   Google Scholar
• Müller , KR , Mika , S , Rätsch , G , Tsuda , K and Schölkopf , B . 2001 . An introduction to Kernel Based Learning Algorithms . IEEE Transactions on Neural Networks , 12 ( 2 ) : 181 – 201 .
   PubMed Web of Science ®Google Scholar
• Murray-Smith , R . 1994 . “ A Local Model Network Approach to Nonlinear Modelling ” . In PhD thesis , Glasgow : Dept. of Computer Science University of Strathclyde .
   Google Scholar
• Murray-Smith , R and Johansen , TA . 1997 . Multiple Model Approaches to Modelling and Control , London : Taylor and Francis .
   Google Scholar
• Myers , RH and Montgomery , DC . 1995 . Response Surface Methodology: Process and Product Design using Designed Experimetns , New York : Wiley .
   Google Scholar
• Neal , RM . 1996 . Bayesian Learning for Neural Networks , New York : Springer-Verlag .
   Google Scholar
• Nishii , R . 1984 . Asymptotic Properties of Criteria for selection of Variables in Mutiple Regression . The Annals of Statistics , 12 ( 2 ) : 758 – 765 .
   Web of Science ®Google Scholar
• Nunnari , G , Dorling , S , Schlink , U , Cawled , G , Foxall , R and Chatterton , T . 2004 . Modelling SO2 Concentration at a Point with Statistical Approaches . Environmental Modelling  & Software , 19 ( 10 ) : 887 – 905 .
   Web of Science ®Google Scholar
• Orr , MJL . 1995 . Regularisation in the Selection of Radial Basis Function Centers . Neural Computation , 7 ( 3 ) : 954 – 975 .
   Web of Science ®Google Scholar
• Park , DC , El-Sharkawi , MA and Marks , RJ II . 1991 . An Adaptively Trained Neural Network . IEEE Transactions on Neural Networks , 2 ( 3 ) : 334 – 345 .
   PubMed Web of Science ®Google Scholar
• Parlitz , U , Hornstein , A , Engster , D , Al-Bender , F , Lampaert , V , Tjahjowidodo , T , Fassois , SD , Rizos , D , Wong , CX , Worden , K and Manso , G . 2004 . Identification of Pre-sliding Friction Dynamics . Chaos , 14 ( 2 ) : 420 – 430 .
   PubMed Web of Science ®Google Scholar
• Pelckmans , K , Suykens , JAK and De Moor , B . 2005 . Neurocomputing , 64 : 137 – 159 .
   Web of Science ®Google Scholar
• Peng , H , Ozaki , T , Toyodac , Y , Shioyad , H , Nakanoe , K , Haggan-Ozakif , V and Mori , M . 2004 . Modelling and Prediction of NOx Emission in a Coal-fired Power Generation Plant . Control Engineering Practice , 12 : 191 – 203 .
   Web of Science ®Google Scholar
• Peng , J , Li , K and Huang , DS . 2006 . A Hybrid forward Algorithm for RBF Neural Network Construction . IEEE Transactions on Neural Networks , 17 ( 6 ) : 1439 – 1451 .
   PubMed Web of Science ®Google Scholar
• Platt , J . 1991 . A Resource Allocating Network for Function interpolation . Neural Computation , 3 ( 2 ) : 213 – 225 .
   PubMed Web of Science ®Google Scholar
• Platt , J . 1999 . “ Fast Training of Support Vector Machines using Sequential Minimal Optimization ” . In Advances in Kernel Methods  – Support Vector Learning , Edited by: Burges , CJC , Schölkopf , B and Smola , AJ . 185 – 208 . Cambridge, MA : MIT Press .
   Google Scholar
• Plutowski , M and White , H . 1993 . Selecting Concise Training Sets from Clean Data . IEEE Transactions on Neural Netwoks , 4 : 305 – 318 .
   PubMed Web of Science ®Google Scholar
• Powell , MJD . 1985 . “ Radial Basis Functions for Multivariable interpolation: A Review ” . In Algorithms for Approximation , Edited by: Mansonn , JC and Cox , MG . 143 – 167 . Oxford : Oxford University Press .
   Google Scholar
• Priestley , MB . 1981 . Spectral Analysis and Time Series , London, New York : Academic Press .
   Google Scholar
• Raghavan , H , Gopaluni , RB , Shah , S , Pakpahan , J , Patwardhan , R and Robson , C . 2005 . Gray-box Identification of Dynamic Models for the Bleaching Operation in a Pulp Mill . Journal of Process Control , 15 ( 4 ) : 451 – 468 .
   Web of Science ®Google Scholar
• Rao , GP . 2006 . Identification of Continuous-time Systems . IEE Proceedings  – Control Theory Applications , 153 ( 2 ) : 185 – 220 .
   Web of Science ®Google Scholar
• Ribeiro , B . 2005 . Support Vector Machines for Quality Monitoring in a Plastic Injection Molding Process . IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews , 35 ( 3 ) : 401 – 410 .
   Web of Science ®Google Scholar
• Rojas , CR , Welsh , JS , Goodwin , GC and Feuer , A . 2007 . Robust Optimal Experiment Design for System Identification . Automatica , 43 : 993 – 1008 .
   Web of Science ®Google Scholar
• Ruano , AE . 2005 . Intelligent Control Systems using Computational Intelligence Techniques , London : IEE Publishing .
   Google Scholar
• Sanner , R and Slotine , J . 1992 . Gaussian Networks for Direct Adaptive Control . IEEE Transactions on Neural Networks , 3 ( 6 ) : 837 – 863 .
   PubMed Web of Science ®Google Scholar
• Sargantanis , IG and Karim , MN . 2004 . Variable Structure NARX Models: Application to Dissolved-Oxygen Bioprocess . AIChE Journal , 45 ( 9 ) : 2034 – 2045 .
   Web of Science ®Google Scholar
• Shevade , SK , Keerthi , SS , Bhattacharyya , C and Murthy , KRK . 2000 . Improvements to the SMO Algortihms for SVM Regression . IEEE Transactions on Neural Networks , 11 ( 5 ) : 1188 – 1193 .
   PubMed Web of Science ®Google Scholar
• Sindelář , R and Babuška , R . 2004 . Input Selection for Nonlinear Regression Models . IEEE Transactions on Fuzzy Systems , 12 ( 5 ) : 688 – 696 .
   Web of Science ®Google Scholar
• Sjöberg , J , Zhang , Q , Ljung , L , Benveniste , A , Delyon , B , Glorennec , P , Hjalmarsson , H and Juditsky , A . 1995 . Nonlinear Black-box Modelling in System Identification: A Unified Overview . Automatica , 31 ( 12 ) : 1691 – 1724 .
   Web of Science ®Google Scholar
• Smola , AJ . 1998 . Learning with Kernels. Ph.D. thesis , Germany : Informatik der Technischen Universitate Berlin .
   Google Scholar
• Smola , AJ and Schölkopf , B . 1998 . “ A Tutorial on Support Vector Regression ” . In NeuroCOLT Technical Report NC-TR-98-030 , London : Royal Holloway College, University of . http://www.kernel-machines.org/tutorial.html
   Google Scholar
• Söderström , T . 2006 . “ Errors-in-variables Methods in System Identification ” . In Proc. 14th IFAC Symposium on System Identification , Australia : Newcastle .
   Google Scholar
• Söderström , T and Stoica , P . 1989 . System Identification , New York : Prentice Hall .
   Google Scholar
• Söderström , T and Stoica , P . 1990 . On Covariance Function Tests Used in System Identification . Automatica , 26 : 125 – 133 .
   Web of Science ®Google Scholar
• Söderström , T , Van den Hof , P , Wahlberg , B and Weiland , S . 2005 . Special Issue on Data-based Modelling and System Identification . Automatica , 41 ( 3 ) : 357 – 562 .
   Web of Science ®Google Scholar
• Soumelidis , MI and Stobart , RK . 2006 . Dynamic Modelling of Three-way Catalysts using Non-linear Identification Techniques . Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering , 220 ( 7 ) : 595 – 605 .
   Web of Science ®Google Scholar
• Stewart , P , Fleming , PJ and MacKenzie , SA . 2003 . Real-time Simulation and Control Design by the Response Surface Methodology and Design of Experiments . International Journal of Systems Science , 34 ( 14–15 ) : 837 – 850 .
   Web of Science ®Google Scholar
• Stone , M . 1974 . Cross Validatory Choie and Assessment of Statistical Predictions . Journal of the Royal Statistical Society, Series B , 36 : 117 – 147 .
   Google Scholar
• Sugiyama , M and Ogawa , H . 2001 . Incremental Projection Learning for Optimal Generalization . Neural Networks , 14 ( 1 ) : 67 – 78 .
   PubMed Web of Science ®Google Scholar
• Suykens , JAK , Van Gestel , T , De Brabanter , J , De Moor , B and Vandewalle , J . 2002 . Least Squares Support Vector Machines , Singapore : World Scientific .
   Google Scholar
• Tibshirani , R . 1996 . Regression Shrinkage and Selection via the Lasso . Journal of Royal Statistical Society. Series B , 58 ( 1 ) : 267 – 288 .
   Google Scholar
• Tothill , RW , Kowalczyk , A , Rischin , D , Bousioutas , A , Haviv , I , van Laar , RK , Waring , PM , Zalcberg , J , Ward , R , Biankin , AV , Sutherland , RL , Henshall , SM , Fong , K , Pollack , JR , Bowtell , DDL and Holloway , AJ . 2005 . An Expression-based Site of Origin Diagnostic Method Designed for Clinical Application to Cancer of Unknown Origin . Cancer Research , 65 ( 10 ) : 4031 – 4040 .
   PubMed Web of Science ®Google Scholar
• Townsend , S and Irwin , GW . 2001 . “ Nonlinear Model Based Predictive Control using Multiple Local Models ” . In Nonlinear Predictive Control: Theory and Practice , Edited by: Kouvaritakis , B and Cannon , M . London : IEE, Control Engineering . Book Series 61
   Google Scholar
• Tsang , KM and Chan , WL . 2005 . Adaptive Control of Power Factor Correction Converter using Nonliear System Identification . IEE Proceedings Electric Power Applications , 152 ( 3 ) : 627 – 633 .
   Google Scholar
• Vanderbei , RJ . 1999 . LOQO: An Interior Point Code for Quadratic Programming . Optimization Methods and Software , 11 ( 1–4 ) : 451 – 484 .
   Web of Science ®Google Scholar
• Vapnik , V . 1995 . The Nature of Statictical Learning Theory , New York : Springer-Verlag .
   Google Scholar
• Vapnik , V . 1998 . Statistical Learning Theory , New York : J. Wiley .
   Google Scholar
• Vemuri , A , Polycarpou , M and Diakourtis , S . 1998 . Neural Network Based Fault Detection and Accommodation in Robotic Manipulators . IEEE Transactions on Robotics and Automation , 14 ( 2 ) : 342 – 348 .
   Google Scholar
• Wahba , G . 1990 . “ Spline Models for Observational Data ” . In Society for Industrial and Applied Mathematics
   Google Scholar
• Wang , L and Mendel , JM . 1992 . Fuzzy Basis Functions, Universal Approximation, and Orthogonal Least-squares Learning . IEEE Transactions on Neural Networks , 5 : 807 – 814 .
   Web of Science ®Google Scholar
• Wilson , DJH , Irwin , GW and Lightbody , G . 1999 . RbF Principal Surfaces for Process Monitoring . IEEE Trans on Neural Networks , 10 ( 6 ) : 1424 – 1434 .
   PubMed Web of Science ®Google Scholar
• Xia , X and Li , K . 2007 . A New Score Correlation analysis Multi-class Support Vector Machine for Microarray . 2007 International Joint Conference on Neural Networks . 2007 , Florida. Orlendo
   Google Scholar
• Xie , N and Leung , H . 2005 . Blind Equalization using a Predictive Radial Basis Function Neural Network . IEEE Transactions on Neural Networks , 16 ( 3 ) : 709 – 720 .
   PubMed Web of Science ®Google Scholar
• Yingwei , L , Sundararajan , N and Saratchandran , P . 1998 . Performance Evaluation of a Sequential Minimal Radial Basisfunction (RBF) Neural Network Learning Algorithm . IEEE Transactions on Neural Networks , 9 ( 2 ) : 308 – 318 .
   PubMed Web of Science ®Google Scholar
• Young , PC . 1984 . Recursive Estimation and Time Series Analysis , Berlin : Springer-Verlag .
   Google Scholar
• Zhang , Q . 1993 . Using Wavelets Network in Nonparametric Estimation . IEEE Transactions on Neural Networks , 8 ( 2 ) 1997
   Google Scholar
• Zhang , LF , Zhu , QM and Longden , A . 2007 . A Set of Novel Correlation Tests for Nonlinear System Variables . International Journal of Systems Science , 38 ( 1 ) : 47 – 60 .
   Web of Science ®Google Scholar
• Zheng , GL and Billings , SA . 1996 . Radial Basis Function Network Configuration using Mutual Information and the Orthogonal Least Squares Algorithm . Neural Networks , 9 : 1619 – 1637 .
   PubMed Web of Science ®Google Scholar
• Zheng , GL and Billings , SA . 1999 . Qualitative Validation and Generalization in Non-linear System Identification . International Journal of Control , 72 ( 17 ) : 1592 – 1608 .
   Web of Science ®Google Scholar
• Zheng , GL and Billings , SA . 2002 . Effects of Overparameterisation in Nonlinear System Identification and Neural Networks . International Journal of Systems Science , 33 ( 5 ) : 331 – 349 .
   Web of Science ®Google Scholar
• Zhong , ZD , Zhu , XJ and Cao , GY . 2006 . Modeling a PEMFC by a Support Vector Machine . Journal of Power Sources , 160 ( 1 ) : 293 – 298 .
   Web of Science ®Google Scholar