648
Views
0
CrossRef citations to date
0
Altmetric
Artificial Intelligence and Machine Learning

External validation of the prediction model of intradialytic hypotension: a multicenter prospective cohort study

, , , , , & show all
Article: 2322031 | Received 31 Aug 2023, Accepted 17 Feb 2024, Published online: 11 Mar 2024
 

Abstract

Objective

Intradialytic hypotension (IDH) is a common and serious complication in patients with Maintenance Hemodialysis (MHD). The purpose of this study is to externally verify three IDH risk prediction models recently developed by Ma et al. and recalibrate, update and present the optimal model to improve the accuracy and applicability of the model in clinical environment.

Methods

A multicenter prospective cohort study of patients from 11 hemodialysis centers in Sichuan Province, China, was conducted using convenience sampling from March 2022 to July 2022, with a follow-up period of 1 month. Model performance was assessed by: (1) Discrimination: Evaluated through the computation of the Area Under Curve (AUC) and its corresponding 95% confidence intervals. (2) Calibration: scrutinized through visual inspection of the calibration plot and utilization of the Brier score. (3) The incremental value of risk prediction and the utility of updating the model were gauged using NRI (Net Reclassification Improvement) and IDI (Integrated Discrimination Improvement). Decision Curve Analysis (DCA) was employed to evaluate the clinical benefit of updating the model.

Results

The final cohort comprised 2235 individuals undergoing maintenance hemodialysis, exhibiting a 14.6% occurrence rate of IDH. The externally validated Area Under the Curve (AUC) values for the three original prediction models were 0.746 (95% CI: 0.718 to 0.775), 0.709 (95% CI: 0.679 to 0.739), and 0.735 (95% CI: 0.706 to 0.764) respectively. Conversely, the AUC value for the recalibrated and updated columnar plot model reached 0.817 (95% CI: 0.791 to 0.842), accompanied by a Brier score of 0.081. Furthermore, Decision Curve Analysis (DCA) exhibited a net benefit within the threshold probability range of 15.2% to 87.1%.

Conclusion

Externally validated, recalibrated, updated, and presented IDH prediction models may serve as a valuable instrument for evaluating IDH risk in clinical practice. Furthermore, they hold the potential to guide clinical providers in discerning individuals at risk and facilitating judicious clinical intervention decisions.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Statement of ethics

This study was approved by the Ethics Committee of the First Affiliated Hospital of Chengdu Medical College (Ethics Approval No. 2021CYFYIRB-BA-63-02). This research study was conducted in accordance with the guidelines of the Declaration of Helsinki. All patients have informed consent.

Additional information

Funding

This study was supported by the Sichuan applied psychology research center (CSXL-22309), the Scientific Research Program of Sichuan Nursing Society (H22021).