5
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      An Explainable Machine Learning Model to Predict Acute Kidney Injury After Cardiac Surgery: A Retrospective Cohort Study

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          To derive and validate a machine learning (ML) prediction model of acute kidney injury (AKI) that could be used for AKI surveillance and management to improve clinical outcomes.

          Methods

          This retrospective cohort study was conducted in Fuwai Hospital, including patients aged 18 years and above undergoing cardiac surgery admitted between January 1, 2017, and December 31, 2018. Seventy percent of the observations were randomly selected for training and the remaining 30% for testing. The demographics, comorbidities, laboratory examination parameters, and operation details were used to construct a prediction model for AKI by logistic regression and eXtreme gradient boosting (Xgboost). The discrimination of each model was assessed on the test cohort by the area under the receiver operator characteristic (AUROC) curve, while calibration was performed by the calibration plot.

          Results

          A total of 15,880 patients were enrolled in this study, and 4845 (30.5%) had developed AKI. Xgboost model had the higher discriminative ability compared with logistic regression (AUROC, 0.849 [95% CI, 0.837–0.861] vs 0.803[95% CI 0.790–0.817], P<0.001) in the test dataset. The estimated glomerular filtration (eGFR) and creatine on intensive care unit (ICU) arrival are the two most important prediction parameters. A SHAP summary plot was used to illustrate the effects of the top 15 features attributed to the Xgboost model.

          Conclusion

          ML models can provide clinical decision support to determine which patients should focus on perioperative preventive treatment to preemptively reduce acute kidney injury by predicting which patients are not at risk.

          Related collections

          Most cited references32

          • Record: found
          • Abstract: found
          • Article: not found

          A new equation to estimate glomerular filtration rate.

          Equations to estimate glomerular filtration rate (GFR) are routinely used to assess kidney function. Current equations have limited precision and systematically underestimate measured GFR at higher values. To develop a new estimating equation for GFR: the Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) equation. Cross-sectional analysis with separate pooled data sets for equation development and validation and a representative sample of the U.S. population for prevalence estimates. Research studies and clinical populations ("studies") with measured GFR and NHANES (National Health and Nutrition Examination Survey), 1999 to 2006. 8254 participants in 10 studies (equation development data set) and 3896 participants in 16 studies (validation data set). Prevalence estimates were based on 16,032 participants in NHANES. GFR, measured as the clearance of exogenous filtration markers (iothalamate in the development data set; iothalamate and other markers in the validation data set), and linear regression to estimate the logarithm of measured GFR from standardized creatinine levels, sex, race, and age. In the validation data set, the CKD-EPI equation performed better than the Modification of Diet in Renal Disease Study equation, especially at higher GFR (P < 0.001 for all subsequent comparisons), with less bias (median difference between measured and estimated GFR, 2.5 vs. 5.5 mL/min per 1.73 m(2)), improved precision (interquartile range [IQR] of the differences, 16.6 vs. 18.3 mL/min per 1.73 m(2)), and greater accuracy (percentage of estimated GFR within 30% of measured GFR, 84.1% vs. 80.6%). In NHANES, the median estimated GFR was 94.5 mL/min per 1.73 m(2) (IQR, 79.7 to 108.1) vs. 85.0 (IQR, 72.9 to 98.5) mL/min per 1.73 m(2), and the prevalence of chronic kidney disease was 11.5% (95% CI, 10.6% to 12.4%) versus 13.1% (CI, 12.1% to 14.0%). The sample contained a limited number of elderly people and racial and ethnic minorities with measured GFR. The CKD-EPI creatinine equation is more accurate than the Modification of Diet in Renal Disease Study equation and could replace it for routine clinical use. National Institute of Diabetes and Digestive and Kidney Diseases.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models

            The objective of this study was to compare performance of logistic regression (LR) with machine learning (ML) for clinical prediction modeling in the literature.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              A clinical score to predict acute renal failure after cardiac surgery.

              The risk of mortality associated with acute renal failure (ARF) after open-heart surgery continues to be distressingly high. Accurate prediction of ARF provides an opportunity to develop strategies for early diagnosis and treatment. The aim of this study was to develop a clinical score to predict postoperative ARF by incorporating the effect of all of its major risk factors. A total of 33,217 patients underwent open-heart surgery at the Cleveland Clinic Foundation (1993 to 2002). The primary outcome was ARF that required dialysis. The scoring model was developed in a randomly selected test set (n = 15,838) and was validated on the remaining patients. Its predictive accuracy was compared by area under the receiver operating characteristic curve. The score ranges between 0 and 17 points. The ARF frequency at each score level in the validation set fell within the 95% confidence intervals (CI) of the corresponding frequency in the test set. Four risk categories of increasing severity (scores 0 to 2, 3 to 5, 6 to 8, and 9 to 13) were formed arbitrarily. The frequency of ARF across these categories in the test set ranged between 0.5 and 22.1%. The score was also valid in predicting ARF across all risk categories. The area under the receiver operating characteristic curve for the score in the test set was 0.81 (95% CI 0.78 to 0.83) and was similar to that in the validation set (0.82; 95% CI 0.80 to 0.85; P = 0.39). In conclusion, a score is valid and accurate in predicting ARF after open-heart surgery; along with increasing its clinical utility, the score can help in planning future clinical trials of ARF.
                Bookmark

                Author and article information

                Journal
                Clin Epidemiol
                Clin Epidemiol
                clep
                Clinical Epidemiology
                Dove
                1179-1349
                04 December 2023
                2023
                : 15
                : 1145-1157
                Affiliations
                [1 ]Department of Anesthesiology, State Key Laboratory of Cardiovascular Disease, Fuwai Hospital, National Center of Cardiovascular Diseases, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People’s Republic of China
                [2 ]Department of Anesthesiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People’s Republic of China
                [3 ]Department of Surgical Intensive Care Unit & Anesthesiology, Beijing Shijitan Hospital, Capital Medical University , Beijing, People’s Republic of China
                Author notes
                Correspondence: Yuefu Wang, Department of Surgical Intensive Care Unit & Anesthesiology, Beijing Shijitan Hospital, Capital Medical University , 10 Tieyi Road, Haidian District, Beijing, People’s Republic of China, Email wangyuefu3806@bjsjth.cn
                [*]

                These authors contributed equally to this work

                Article
                404580
                10.2147/CLEP.S404580
                10706584
                38076638
                78373975-8004-46f8-853a-dc534c36c4c5
                © 2023 Gao et al.

                This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution – Non Commercial (unported, v3.0) License ( http://creativecommons.org/licenses/by-nc/3.0/). By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms ( https://www.dovepress.com/terms.php).

                History
                : 25 January 2023
                : 27 September 2023
                Page count
                Figures: 5, Tables: 3, References: 32, Pages: 13
                Funding
                Funded by: Chinese Academy of Medical Sciences Central Public Welfare Scientific Research Institute Basal Research Expenses (2019XK320052);
                This work is supported by the Chinese Academy of Medical Sciences Central Public Welfare Scientific Research Institute Basal Research Expenses (2019XK320052).
                Categories
                Original Research

                Public health
                machine learning,acute kidney injury,cardiac surgery,shapley additive explanations,shap,prediction model

                Comments

                Comment on this article