A novel state energy spatialization regenerative braking control strategy based on Q- learning algorithm for a super-mild hybrid electric vehicle

References

• Andong, Y., and L. Zhang. 2020. Study on energy management strategy for Plug-in hybrid electric bus based on driving cycle recognition. Journal of Hefei University of Technology (Natural Science Edition) 43 (2):145–50.
   Google Scholar
• Cao, Q., J. Li, Y. Liu, and D. Qu. 2019. Construction of driving cycle based on big data and markov chain. Journal of Northeastern University (Natural Science Edition) 40 (1):77–81.
   Google Scholar
• Changran, H., W. Guoye, G. Zhangpeng, X. Zhichao, and X. Dongxin. 2018. A control algorithm for the novel regenerative–mechanical coupled brake system with by-wire based on multidisciplinary design optimization for an electric vehicle. Energies 11 (9):2322. doi:10.3390/en11092322.
   Web of Science ®Google Scholar
• Chen, Q., Y. Xie, S. Guo, Bai, J., and Shu, Q. 2021. Sensing system of environmental perception technologies for driverless vehicle: A review of state of the art and challenges. Sensors and Actuators. A, Physical 319:112566. doi:10.1016/j.sna.2021.112566.
   Google Scholar
• Ericsson, E. 2001. Independent driving pattern factors and their influence on fuel-use and exhaust emission factors. Transportation Research Part D: Transport and Environment 6 (5):325–45. doi:10.1016/S1361-9209(01)00003-7.
   Web of Science ®Google Scholar
• Filev, D. P., and I. V. Kolmanovsky. 2014. Generalized markov models for real-time modeling of continuous systems. IEEE Transactions on Fuzzy Systems 22 (4):983–98. doi:10.1109/TFUZZ.2013.2279535.
   Web of Science ®Google Scholar
• Frendo, O., J. Graf, N. Gaertner, and H. Stuckenschmidt. 2020. Data-driven smart charging for heterogeneous electric vehicle fleets. Energy and AI 1:100007. 10.1016/j.egyai.2020.100007
   Google Scholar
• Guo, Q., Z. Zhao, P. Shen, X. Zhan, and J. Li. 2019. Adaptive optimal control based on driving style recognition for plug-in hybrid electric vehicle. Energy 186:115824. doi:10.1016/j.energy.2019.07.154.
   Web of Science ®Google Scholar
• Harshavarthini, S., Divya, M., Bongarla, R., Priya, C. H., and Balaji, R. 2021. A critical investigation on regenerative braking energy recovering system on HEV based on electric and natural extracted fuel. Materials Today: Proceedings.
   Google Scholar
• Hernández, L. G., Mozos, O. M., Ferrández, J. M., and Antelis, J. M.  2018. EEG-based detection of braking intention under different car driving conditions. Frontiers in Neuroinformatics 12:29. doi:10.3389/fninf.2018.00029.
   PubMed Web of Science ®Google Scholar
• Hu, J., Li, J., Hu, Z., Xu, L., and Ouyang, M.  2021. Power distribution strategy of a dual-engine system for heavy-duty hybrid electric vehicles using dynamic programming. Energy 215:118851. doi:10.1016/j.energy.2020.118851.
   Web of Science ®Google Scholar
• Jingang, G., H. Dong, W. Sheng, and T. Chao. 2018. An optimal control strategy for regenerative braking energy recovery of electric vehicles. Journal of Jiangsu University (Natural Science Edition) 39 (2):132–38.
   Google Scholar
• Junzhi, Z., L. Yutong, L. Chen, and Y. Ye. 2014. New regenerative braking control strategy for rear-driven electrified minivans. Energy Conversion and Management 82 (Jun):135–45. doi:10.1016/j.enconman.2014.03.015.
   Google Scholar
• Kim, I. H., J. W. Kim, S. Haufe, and S. W. Lee. 2014. Detection of braking intention in diverse situations during simulated driving based on EEG feature combination. Journal of Neural Engineering 12 (1):1–13.
   Web of Science ®Google Scholar
• Kim, J. W., I. H. Kim, and S. W. Lee. 2016. Detection of braking intention during simulated driving based on EEG analysis: Online study. Hong Kong:IEEE international conference on systems, man, and cybernetics 887–91.
   Google Scholar
• Lei, S., X. Lin, and G. Lin. 2017. Energy management strategy based on type recognition and multivariate nonlinear regression optimization. China Mechanical Engineering 28 (22):2695–700.
   Google Scholar
• Li, L., Yang, C., Zhang, Y., Zhang, L., and Song, J. 2015. Correctional DP-based energy management strategy of plug-in hybrid electric bus for city-bus route. IEEE Transactions on Vehicular Technology 64(7):2792–803. doi:10.1109/TVT.2014.2352357.
   Web of Science ®Google Scholar
• Li, N., X. Ning, and Q. Wang. 2017. Genetic algorithm optimization of hydraulic regenerative braking system for electric vehicles. Boletin Tecnico/technical Bulletin 55 (6):513–23.
   Google Scholar
• Li, S. Q., B. Yu, and F. Xy. 2019. Research on braking energy recovery strategy of electric vehicle based on ECE regulation and I curve. Science Progress 103(1), 0036850419877762.
   Web of Science ®Google Scholar
• Li, Z., A. Khajepour, and J. Song. 2019. A comprehensive review of the key technologies for pure electric vehicles. Energy 182:824–39. doi:10.1016/j.energy.2019.06.077.
   Web of Science ®Google Scholar
• Liang, Z., and X. Cai. 2018. Control strategy of regenerative braking system in electric vehicles. In Energy Procedi, 496–501.
   Google Scholar
• Lin, C. C., H. Peng, and J. W. Grizzle. 2004. A stochastic control strategy for hybrid electric vehicles.Boston:  American Control Conference. IEEE 5:4710–15.
   Google Scholar
• Lin, X., B. Zhou, and Y. Xia. 2020. Online recursive power management strategy based on the reinforcement learning algorithm with cosine similarity and a forgetting factor. IEEE Transactions on Industrial Electronics 67 (9):7757–66. doi:10.1109/tie.2019.2942512.
   PubMedGoogle Scholar
• Lin, X., S. Zeng, and X. Li. 2021. Online correction predictive energy management strategy using the Q-learning based swarm optimization with fuzzy neural network. Energy 223:120071. doi:10.1016/j.energy.2021.120071.
   Web of Science ®Google Scholar
• Lissa, P., Deane, C., Schukat, M., Seri, F., Keane, M., and Barrett, E. 2021. Deep reinforcement learning for home energy management system control. Energy and AI 3:100043. doi:10.1016/j.egyai.2020.100043.
   Google Scholar
• xxx
   Google Scholar
• Pei, X., H. Pan, and Z. Chen. 2020. Coordinated control strategy of electro-hydraulic braking for energy regeneration. Control Engineering Practice 01:104324. doi:10.1016/j.conengprac.2020.104324.
   Google Scholar
• Rached, Z., F. Alajaji, and L. L. L. Campbell. 2004. The kullback–Leibler divergence rate between Markov sources. IEEE Trans Inform Theory 50 (5):917–21. doi:10.1109/TIT.2004.826687.
   Web of Science ®Google Scholar
• Renzong, L., P. Jiankun, W. Yuankai, Tan, H., and Zhang, H. 2020. Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle. Energy 197:117297. doi:10.1016/j.energy.2020.117297.
   Web of Science ®Google Scholar
• Sen, Z., Q. Datong, and Z. Yuping. 2016. Energy management strategy of HEV based on driving cycle recognition using genetic optimized K-means clustering algorithm. China Journal of Highway and Transport 29 (4):130–37. 152.
   Google Scholar
• Shen, P., Z. Zhao, J. Li, and X. Zhan. 2018. Development of a typical driving cycle for an intra-city hybrid electric bus with a fixed route. Transportation Research Part D Transport & Environment 59:346–60. doi:10.1016/j.trd.2018.01.032.
   Web of Science ®Google Scholar
• Sun, H., Z. Fu, F. Tao, L. Zhu, and P. Si. 2020. Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles. Journal of Power Sources 455:227964. 10.1016/j.jpowsour.2020.227964
   Web of Science ®Google Scholar
• Sun, Y., Y. Wang, R. Zhu, R. Geng, J. Zhang, D. Fan, and H.Wang. 2018. Study on the control strategy of regenerative braking for the hybrid electric vehicle under typical braking condition. United Kingdom:Iop Conference 452.
   Google Scholar
• Tai, Y., J. Song, L. Yu, X. Liu, and Z. Lu. 2019. A four-step control algorithm and downshift schedule of a seamless shift transmission equipped on electric vehicles during the regenerative braking process. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering 233 ( 8):1982–99.
   Google Scholar
• Tao, D., J. Luo, H. Han, M. Wang, and D. Cheng. 2018. Adaptive energy management strategy based on driving cycle recognition for hybrid electric vehicles. Journal of Xi’an Jiaotong University 052 (1):77–83.
   Google Scholar
• Teng, L., B. Wang, and Y. Chenglang. 2018. Online markov chain-based energy management for a hybrid tracked vehicle with speedy Q-learning. Energy 160:544–55. doi:10.1016/j.energy.2018.07.022.
   Web of Science ®Google Scholar
• Wang, C., W. Zhao, and W. Li. 2018. Braking sense consistency strategy of electro-hydraulic composite braking system. Mechanical Systems and Signal Processing 109(SEP.):196–219. doi:10.1016/j.ymssp.2018.02.047.
   Google Scholar
• Wu, B., W. D. Widanage, S. Yang, and X. Liu. 2020. Battery digital twins: Perspectives on the fusion of models, data and artificial intelligence for smart battery management systems. Energy and AI 1:100016. doi:10.1016/j.egyai.2020.100016.
   Google Scholar
• Wu, D., B. Zhu, D. Kui, and Tan. 2019. Multi-objective optimization strategy of adaptive cruise control considering regenerative energy. Automobile Engineering 12:1–16.
   Google Scholar
• Xinyou, L., and S. Dongye. 2012. Driving pattern recognition based on ECMS and its application to control strategy for a series-parallel hybrid electric bus. Journal of Hunan University (Natural Sciences) 39 (10):43–49.
   Google Scholar
• Xu, B., D. Rathod, D. Zhang, A. Yebi, X. Zhang, X. Li, and Z. Filipi. 2020. Parametric study on reinforcement learning optimized energy management strategy for a hybrid electric vehicle. Applied Energy 259:114200. doi:10.1016/j.apenergy.2019.114200.
   Web of Science ®Google Scholar
• Xu, Q., F. Wang, X. Zhang, and S. Cui. 2019. Research on the efficiency optimization control of the regenerative braking system of hybrid electrical vehicle based on electrical variable transmission. IEEE Access 7:116823–34. doi:10.1109/ACCESS.2019.2936370.
   Web of Science ®Google Scholar
• Xu, W., H. Chen, H. Zhao,and B. Ren. 2019. Torque optimization control for electric vehicles with four in-wheel motors equipped with regenerative braking system. Mechatronics 57:95–108. doi:10.1016/j.mechatronics.2018.11.006.
   Web of Science ®Google Scholar
• Yimin, G., L. Chen, and M. Ehsani. 2000. Investigation of the effectiveness of regenerative braking for EV and HEV. Univ of California-Davis:Future Transportation Technology Conference: SAE Technical Papers on CD-ROM 1–9.
   Google Scholar
• Yonggang, L., G. Jun, Q. Datong, Y. Zhang, and Z. Lei. 2018. Rule-corrected energy management strategy for hybrid electric vehicles based on operation-mode prediction. Journal of Cleaner Production 188:796–806. doi:10.1016/j.jclepro.2018.04.024.
   Web of Science ®Google Scholar
• Zhang, Z., Y. Dong, and Y. Han. 2019. Dynamic and control of electric vehicle in regenerative braking for driving safety and energy conservation. Journal of Vibration Engineering & Technologies
   Web of Science ®Google Scholar
• Zhou, Z., and M. Huang. 2019. Regenerative braking algorithm for the electric vehicle with a seamless two-speed transmission. proceedings of the institution of mechanical engineers. Part D: Journal of Automobile Engineering 233 (4):905–16.
   Web of Science ®Google Scholar
• Zou, Y., T. Liu, D. Liu, and F. Sun. 2016. Reinforcement learning-based real-time energy management for a hybrid tracked vehicle. Applied Energy 171:372–82. doi:10.1016/j.apenergy.2016.03.082.
   Web of Science ®Google Scholar