1
views
0
recommends
+1 Recommend
1 collections
    0
    shares

      To submit your manuscript, please click here

      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Combining Federated Machine Learning and Qualitative Methods to Investigate Novel Pediatric Asthma Subtypes: Protocol for a Mixed Methods Study

      research-article

      Read this article at

      ScienceOpenPublisherPMC
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Pediatric asthma is a heterogeneous disease; however, current characterizations of its subtypes are limited. Machine learning (ML) methods are well-suited for identifying subtypes. In particular, deep neural networks can learn patient representations by leveraging longitudinal information captured in electronic health records (EHRs) while considering future outcomes. However, the traditional approach for subtype analysis requires large amounts of EHR data, which may contain protected health information causing potential concerns regarding patient privacy. Federated learning is the key technology to address privacy concerns while preserving the accuracy and performance of ML algorithms. Federated learning could enable multisite development and implementation of ML algorithms to facilitate the translation of artificial intelligence into clinical practice.

          Objective

          The aim of this study is to develop a research protocol for implementation of federated ML across a large clinical research network to identify and discover pediatric asthma subtypes and their progression over time.

          Methods

          This mixed methods study uses data and clinicians from the OneFlorida+ clinical research network, which is a large regional network covering linked and longitudinal patient-level real-world data (RWD) of over 20 million patients from Florida, Georgia, and Alabama in the United States. To characterize the subtypes, we will use OneFlorida+ data from 2011 to 2023 and develop a research-grade pediatric asthma computable phenotype and clinical natural language processing pipeline to identify pediatric patients with asthma aged 2-18 years. We will then apply federated learning to characterize pediatric asthma subtypes and their temporal progression. Using the Promoting Action on Research Implementation in Health Services framework, we will conduct focus groups with practicing pediatric asthma clinicians within the OneFlorida+ network to investigate the clinical utility of the subtypes. With a user-centered design, we will create prototypes to visualize the subtypes in the EHR to best assist with the clinical management of children with asthma.

          Results

          OneFlorida+ data from 2011 to 2023 have been collected for 411,628 patients aged 2-18 years along with 11,156,148 clinical notes. We expect to complete the computable phenotyping within the first year of the project, followed by subtyping during the second and third years, and then will perform the focus groups and establish the user-centered design in the fourth and fifth years of the project.

          Conclusions

          Pediatric asthma subtypes incorporating RWD from diverse populations could improve patient outcomes by moving the field closer to precision pediatric asthma care. Our privacy-preserving federated learning methodology and qualitative implementation work will address several challenges of applying ML to large, multicenter RWD data.

          International Registered Report Identifier (IRRID)

          DERR1-10.2196/57981

          Related collections

          Most cited references41

          • Record: found
          • Abstract: found
          • Article: not found

          Attention Is All You Need

          The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration. The best performing models also connect the encoder and decoder through an attention mechanism. We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable and requiring significantly less time to train. Our model achieves 28.4 BLEU on the WMT 2014 English-to-German translation task, improving over the existing best results, including ensembles by over 2 BLEU. On the WMT 2014 English-to-French translation task, our model establishes a new single-model state-of-the-art BLEU score of 41.8 after training for 3.5 days on eight GPUs, a small fraction of the training costs of the best models from the literature. We show that the Transformer generalizes well to other tasks by applying it successfully to English constituency parsing both with large and limited training data. 15 pages, 5 figures
            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Key challenges for delivering clinical impact with artificial intelligence

            Background Artificial intelligence (AI) research in healthcare is accelerating rapidly, with potential applications being demonstrated across various domains of medicine. However, there are currently limited examples of such techniques being successfully deployed into clinical practice. This article explores the main challenges and limitations of AI in healthcare, and considers the steps required to translate these potentially transformative technologies from research to clinical practice. Main body Key challenges for the translation of AI systems in healthcare include those intrinsic to the science of machine learning, logistical difficulties in implementation, and consideration of the barriers to adoption as well as of the necessary sociocultural or pathway changes. Robust peer-reviewed clinical evaluation as part of randomised controlled trials should be viewed as the gold standard for evidence generation, but conducting these in practice may not always be appropriate or feasible. Performance metrics should aim to capture real clinical applicability and be understandable to intended users. Regulation that balances the pace of innovation with the potential for harm, alongside thoughtful post-market surveillance, is required to ensure that patients are not exposed to dangerous interventions nor deprived of access to beneficial innovations. Mechanisms to enable direct comparisons of AI systems must be developed, including the use of independent, local and representative test sets. Developers of AI algorithms must be vigilant to potential dangers, including dataset shift, accidental fitting of confounders, unintended discriminatory bias, the challenges of generalisation to new populations, and the unintended negative consequences of new algorithms on health outcomes. Conclusion The safe and timely translation of AI research into clinically validated and appropriately regulated systems that can benefit everyone is challenging. Robust clinical evaluation, using metrics that are intuitive to clinicians and ideally go beyond measures of technical accuracy to include quality of care and patient outcomes, is essential. Further work is required (1) to identify themes of algorithmic bias and unfairness while developing mitigations to address these, (2) to reduce brittleness and improve generalisability, and (3) to develop methods for improved interpretability of machine learning predictions. If these goals can be achieved, the benefits for patients are likely to be transformational.
              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              Enabling the implementation of evidence based practice: a conceptual framework

                Bookmark

                Author and article information

                Contributors
                Journal
                JMIR Res Protoc
                JMIR Res Protoc
                ResProt
                JMIR Research Protocols
                JMIR Publications (Toronto, Canada )
                1929-0748
                2024
                8 July 2024
                : 13
                : e57981
                Affiliations
                [1 ] Department of Health Outcomes and Biomedical Informatics University of Florida College of Medicine Gainesville, FL United States
                [2 ] Center for Data Solutions University of Florida College of Medicine - Jacksonville Jacksonville, FL United States
                [3 ] Department of Clinical and Health Psychology University of Florida College of Public Health and Health Professions Gainesville, FL United States
                [4 ] Department of Emergency Medicine Center for Data Solutions University of Florida College of Medicine - Jacksonville Jacksonville, FL United States
                Author notes
                Corresponding Author: Jennifer Noel Fishe Jennifer.Fishe@ 123456jax.ufl.edu
                Author information
                https://orcid.org/0000-0001-5291-5198
                https://orcid.org/0009-0001-2614-2416
                https://orcid.org/0009-0003-0695-9896
                https://orcid.org/0000-0002-6908-2708
                https://orcid.org/0000-0002-6780-6135
                https://orcid.org/0000-0003-0896-910X
                https://orcid.org/0000-0001-5601-4039
                https://orcid.org/0000-0001-9037-8143
                Article
                v13i1e57981
                10.2196/57981
                11263892
                38976313
                fba65752-d2c0-4297-97da-0bad94baeb88
                ©Jie Xu, Sankalp Talankar, Jinqian Pan, Ira Harmon, Yonghui Wu, David A Fedele, Jennifer Brailsford, Jennifer Noel Fishe. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 08.07.2024.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.

                History
                : 5 March 2024
                : 13 May 2024
                : 23 May 2024
                : 4 June 2024
                Categories
                Protocol
                Protocol
                Custom metadata
                The proposal for this study was peer-reviewed by: ZRG1 HSS-B (02) - Center for Scientific Review Special Emphasis Panel (National Institutes of Health, USA). See the Multimedia Appendix for the peer-review report;

                pediatric asthma,machine learning,federated learning,qualitative research

                Comments

                Comment on this article