Vibration control of a nonlinear quarter-car active suspension system by reinforcement learning

References

• Appleyard , M and Wellstead , PE . 1995 . Active Suspensions: Some Background . Control Theory and Applications, IEE Proceedings , 142 : 123 – 128 .
   Google Scholar
• Barto , AG and Anandan , P . 1985 . Pattern Recognizing Stochastic Learning Automata . IEEE Transactions on Systems, Man, and Cybernetics , 15 : 360 – 375 .
   Web of Science ®Google Scholar
• Barto , AG and Sutton , RS . 1982 . Simulation of Anticipatory Responses in Classical Conditioning by a Neuronlike Adaptive Element . Behavioral Brain Research , 4 : 221 – 235 .
   PubMed Web of Science ®Google Scholar
• Barto , AG , Sutton , RS and Anderson , CW . 1983 . Neuronlike Elements that can Solve Difficult Learning Problems . IEEE Transactions on Systems, Man, and Cybernetics , SMC-13 : 834 – 846 .
   Web of Science ®Google Scholar
• Barto , AG , Sutton , RS and Brouwer , PS . 1981 . Associative Search Network: A Reinforcement Learning Associative Memory . Biological Cybernetics , 40 : 201 – 211 .
   Web of Science ®Google Scholar
• Barto , AG , Sutton , RS and Watkins , CJC . 1990 . “ Learning and Sequential Decision Making ” . In Learning and Computational Neuroscience , Edited by: Gabriel , M and Moore , JW . 539 – 602 . Cambridge , MA : MIT Press .
   Google Scholar
• Bucak, I.O. (2000), ‘Nonlinear Learning Control by Extended Reinforcement Learning’, doctoral dissertation, Oakland University.
   Google Scholar
• Bucak , IO and Oz , HR . 2008 . An Active Suspension Control Application for a Quarter Car Model (in Turkish) . Proceedings of TOK’08, Automatic Control National Conference , 2 : 545 – 550 .
   Google Scholar
• Bucak , IO and Zohdy , MA . 1999 . Reinforcement Learning Control of a Biped Robot System . International Journal of Intelligent Control and Systems , 3 : 601 – 617 .
   Google Scholar
• Bucak , IO , Zohdy , MA and Shillor , M . 2008 . Motion Control of a Nonlinear Spring by Reinforcement Learning . Control and Intelligent Systems ACTA Press , 1 : 27 – 36 .
   Google Scholar
• Chiang , CK , Chung , HY and Lin , JJ . 1997 . A Self-learning Fuzzy Logic Controller Using Genetic Algorithms with Reinforcements . IEEE Transactions on Fuzzy Systems , 5 : 460 – 467 .
   Web of Science ®Google Scholar
• Gullapalli , V . 1990 . A Stochastic Reinforcement Learning Algorithm for Learning Real-valued Functions . Neural Networks , 3 : 671 – 692 .
   Web of Science ®Google Scholar
• Gullapalli , V , Franklin , JA and Benbrahim , H . 1994 . Acquiring Robot Skills via Reinforcement Learning . IEEE Control Systems , 14 : 13 – 24 .
   Web of Science ®Google Scholar
• Gundogdu , O . 2007 . Optimal Seat and Suspension Design for a Quarter Car with Driver Model Using Genetic Algorithms . International Journal of Industrial Ergonomics , 37 : 327 – 332 .
   Web of Science ®Google Scholar
• Hác , A . 1986 . Stochastic Optimal Control of Vehicle with Elastic Body and Active Suspension . ASME Journal Dynamic Systems, Measurement, and Control , 108 : 106 – 110 .
   Web of Science ®Google Scholar
• Hrovat , D . 1993 . Applications of Optimal Control of Advanced Automotive Suspension Design . ASME Journal Dynamic Systems, Measurement, and Control , 115 : 328 – 342 .
   Web of Science ®Google Scholar
• Hrovat , D . 1997 . Survey of Advanced Suspension Developments and Related Optimal Control Applications . Automatica , 33 : 1781 – 1817 .
   Web of Science ®Google Scholar
• Klopf, A.H. (1972), ‘Brain Function and Adaptive Systems – A Heterostatic Theory’, Technical Report AFCRL-72-0164, Air Force Cambridge Research Laboratories, Bedford, MA.
   Google Scholar
• Kumar, K.K. (1996), ‘Adaptive Critics: Theory and Applications’, in Proceedings of the Artificial Neural Networks in Engineering Conference (ANNIE '96), eds. C.H. Dagli, M. Akay, C.L.P. Chen, B.R. Fernandez, and J. Ghosh, New York: ASME Press, pp. 10–13.
   Google Scholar
• Kurimoto , M and Yoshimura , T . 1998 . Active Suspension of Passenger Cars Using Sliding Mode Controller (Based on reduced models) . International Journal of Vehicle Design , 19 : 402 – 414 .
   Web of Science ®Google Scholar
• Lin , C-K . 2005 . Adaptive Critic Autopilot Design of Bank-to-turn Missiles Using Fuzzy Basis Function Networks . IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics , 35 : 197 – 207 .
   PubMed Web of Science ®Google Scholar
• Lin , CT and Kan , MC . 1998 . Adaptive Fuzzy Command Acquisition with Reinforcement Learning . IEEE Transactions on Fuzzy Systems , 6 : 102 – 121 .
   Web of Science ®Google Scholar
• Lin , YJ , Lu , YQ and Padovan , J . 1993 . Fuzzy Logic Control of Vehicle Suspension Systems . International Journal of Vehicle Design , 14 : 457 – 470 .
   Web of Science ®Google Scholar
• Lin , FJ , Shyu , K-K and Wai , RJ . 2001 . Recurrent-fuzzy-neural-network Sliding-mode Controlled Motor-toggle Servomechanism . IEEE/ASME Transactions on Mechanics , 6 : 453 – 466 .
   Web of Science ®Google Scholar
• Liu , Z , Zhang , E and Ji , Z . 2008 . “ Simulation and Experimental Study of Human Riding Comfort in Dynamic Man-automobile System ” . In Lecture Notes in Computer Science , Edited by: Xiong , C . 577 – 587 . Berlin Heidelberg : Springer-Verlag .
   Google Scholar
• Maciejewski , I , Meyer , L and Krzyzynski , T . 2010 . The Vibration Damping Effectiveness of an Active Seat Suspension System and its Robustness to Varying Mass Loading . Journal of Sound and Vibration , 329 : 3898 – 3914 .
   Web of Science ®Google Scholar
• Moran , A and Nagai , M . 1994 . Optimal Active Control of Nonlinear Vehicle Suspensions Using Neural Networks . JSME International Journal , 37 : 707 – 718 .
   Web of Science ®Google Scholar
• Omidvar, O., and van der Smagt, P., eds. (1997), Neural Systems for Robotics, San Diego, CA: Academic Press.
   Google Scholar
• Ozyigit , H , Oz , HR and Karlik , B . 2001 . Active Suspension Control for Vehicles and Numerical Calculations by Using Artificial Neural Networks . International Journal of Applied Mechanics and Engineering , 6 : 613 – 626 .
   Google Scholar
• Prokhorov , DV and Wunsch , DC . 1997 . Adaptive Critic Designs . IEEE Transactions on Neural Networks , 8 : 997 – 1007 .
   PubMed Web of Science ®Google Scholar
• Rosen , J and Arcan , M . 2003 . Modeling the Human Body/Seat System in a Vibration Environment . Transactions of the ASME, Journal of Biomechanical Engineering , 125 : 223 – 231 .
   PubMed Web of Science ®Google Scholar
• Roukieh , S and Titli , A . 1993 . Design of Active and Semi-active Automotive Suspension Using Fuzzy Logic . IFAC 12th World Congress Preprints of Papers , 2 : 253 – 257 .
   Google Scholar
• Russel , S and Norvig , P . 2003 . Artificial Intelligence: A Modern Approach , Upper Saddle River , NJ : Pearson Education .
   Google Scholar
• Song , KT and Chu , TS . 1998 . Reinforcement Learning and its Application to Force Control of an İndustrial Robot . Control Engineering Practice , 6 : 37 – 44 .
   Web of Science ®Google Scholar
• Sutton, R.S. (1984), ‘Temporal Credit Assignment in Reinforcement Learning’, doctoral dissertation, University of Massachusetts, Amherst.
   Google Scholar
• Sutton , RS . 1988 . Learning to Predict by the Methods of Temporal Differences . Machine Learning , 3 : 9 – 44 .
   Google Scholar
• Sutton , RS . 1996 . Reinforcement Learning , Boston , MA : Kluwer .
   Google Scholar
• Tong , S , Tong , J and Wang , T . 2000 . Fuzzy Adaptive Control of Multivariable Nonlinear System . Fuzzy Sets and System , 3 : 153 – 167 .
   Google Scholar
• Watkins, C.J.C.H. (1989), ‘Learning from Delayed Rewards’, doctoral dissertation, Cambridge University.
   Google Scholar
• Yeh , EC and Tsao , YJ . 1994 . A Fuzzy Preview Control Scheme of Active Suspension for Rough Road . International Journal of Vehicle Design , 15 : 166 – 180 .
   Web of Science ®Google Scholar
• Yoshimura , T , Hiwa , T , Kurimoto , M and Hino , J . 2003 . Active Suspension of a One-Wheel Car Model Using Fuzzy Reasoning and Compensators . International Journal of Vehicle Autonomous Systems , 1 : 196 – 205 .
   Google Scholar
• Yoshimura , T , Kubota , H , Takei , K , Kurimoto , M and Hino , J . 2000 . Construction of an Active Suspension System of a Quarter Car Model Using Fuzzy Reasoning Based on Single Input Rule Modules . International Journal of Vehicle Design , 23 : 297 – 306 .
   Web of Science ®Google Scholar
• Yoshimura , T , Kume , A , Kurimoto , M and Hino , J . 2001 . Construction of an Active Suspension System of a Quarter Car Model Using the Concept of Sliding Mode Control . Journal of Sound and Vibration , 239 : 187 – 199 .
   Web of Science ®Google Scholar
• Yoshimura , T and Sugimoto , M . 1990 . Active Suspension for a Vehicle Travelling on Flexible Beams with an Irregular Surface . Journal of Sound and Vibration , 138 : 433 – 445 .
   Web of Science ®Google Scholar
• Yoshimura , T and Takagi , A . 2004 . Pneumatic Active Suspension System for a One-Wheel Car Model Using Fuzzy Reasoning and a Disturbance Observer . Journal of Zhejiang University SCIENCE , 5 : 1060 – 1068 .
   PubMedGoogle Scholar