34
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Reproducibility and Generalizability in Radiomics Modeling: Possible Strategies in Radiologic and Statistical Perspectives

      review-article
      , MD, PhD 1 , , PhD 2 , , MD, PhD 2 , , , MD, PhD 1
      Korean Journal of Radiology
      The Korean Society of Radiology
      Radiomics, Reproducibility, Generalizability, Machine learning

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Radiomics, which involves the use of high-dimensional quantitative imaging features for predictive purposes, is a powerful tool for developing and testing medical hypotheses. Radiologic and statistical challenges in radiomics include those related to the reproducibility of imaging data, control of overfitting due to high dimensionality, and the generalizability of modeling. The aims of this review article are to clarify the distinctions between radiomics features and other omics and imaging data, to describe the challenges and potential strategies in reproducibility and feature selection, and to reveal the epidemiological background of modeling, thereby facilitating and promoting more reproducible and generalizable radiomics research.

          Related collections

          Most cited references45

          • Record: found
          • Abstract: not found
          • Article: not found

          Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing

            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS).

            In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients-manually annotated by up to four raters-and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.
              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              Statistical pattern recognition: a review

                Bookmark

                Author and article information

                Journal
                Korean J Radiol
                Korean J Radiol
                KJR
                Korean Journal of Radiology
                The Korean Society of Radiology
                1229-6929
                2005-8330
                July 2019
                25 June 2019
                : 20
                : 7
                : 1124-1137
                Affiliations
                [1 ]Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Korea.
                [2 ]Department of Clinical Epidemiology and Biostatistics, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Korea.
                Author notes
                Corresponding author: Hwa Jung Kim, MD, PhD, Department of Clinical Epidemiology and Biostatistics, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpagu, Seoul 05505, Korea. Tel: (822) 3010-5636, Fax: (822) 3010-7304, hello.hello.hj@ 123456gmail.com

                *These authors contributed equally to this work.

                Author information
                https://orcid.org/0000-0002-4419-4682
                https://orcid.org/0000-0002-2702-1536
                https://orcid.org/0000-0003-1916-7014
                https://orcid.org/0000-0002-9477-7421
                Article
                10.3348/kjr.2018.0070
                6609433
                31270976
                bcd35f4a-929a-48c4-a3a9-af8902b4bf63
                Copyright © 2019 The Korean Society of Radiology

                This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License ( http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

                History
                : 25 January 2019
                : 07 April 2019
                Funding
                Funded by: National Research Foundation of Korea, CrossRef https://doi.org/10.13039/501100003725;
                Award ID: NRF-2017R1C1B2007258
                Award ID: NRF-2017R1A2A2A05001217
                Categories
                Technology, Experiment, and Physics
                Review Article

                Radiology & Imaging
                radiomics,reproducibility,generalizability,machine learning
                Radiology & Imaging
                radiomics, reproducibility, generalizability, machine learning

                Comments

                Comment on this article