2
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      How to build up big team science: a practical guide for large-scale collaborations

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          The past decade has witnessed a proliferation of big team science (BTS), endeavours where a comparatively large number of researchers pool their intellectual and/or material resources in pursuit of a common goal. Despite this burgeoning interest, there exists little guidance on how to create, manage and participate in these collaborations. In this paper, we integrate insights from a multi-disciplinary set of BTS initiatives to provide a how-to guide for BTS. We first discuss initial considerations for launching a BTS project, such as building the team, identifying leadership, governance, tools and open science approaches. We then turn to issues related to running and completing a BTS project, such as study design, ethical approvals and issues related to data collection, management and analysis. Finally, we address topics that present special challenges for BTS, including authorship decisions, collaborative writing and team decision-making.

          Related collections

          Most cited references57

          • Record: found
          • Abstract: found
          • Article: not found

          Initial sequencing and analysis of the human genome.

          The human genome holds an extraordinary trove of information about human development, physiology, medicine and evolution. Here we report the results of an international collaboration to produce and make freely available a draft sequence of the human genome. We also present an initial analysis of the data, describing some of the insights that can be gleaned from the sequence.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            PSYCHOLOGY. Estimating the reproducibility of psychological science.

            Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.

              In this article, we accomplish two things. First, we show that despite empirical psychologists' nominal endorsement of a low rate of false-positive findings (≤ .05), flexibility in data collection, analysis, and reporting dramatically increases actual false-positive rates. In many cases, a researcher is more likely to falsely find evidence that an effect exists than to correctly find evidence that it does not. We present computer simulations and a pair of actual experiments that demonstrate how unacceptably easy it is to accumulate (and report) statistically significant evidence for a false hypothesis. Second, we suggest a simple, low-cost, and straightforwardly effective disclosure-based solution to this problem. The solution involves six concrete requirements for authors and four guidelines for reviewers, all of which impose a minimal burden on the publication process.
                Bookmark

                Author and article information

                Contributors
                Role: ConceptualizationRole: Formal analysisRole: Project administrationRole: VisualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – review & editing
                Role: ConceptualizationRole: Writing – original draftRole: Writing – review & editing
                Role: ConceptualizationRole: Formal analysisRole: Project administrationRole: VisualizationRole: Writing – original draftRole: Writing – review & editing
                Journal
                R Soc Open Sci
                R Soc Open Sci
                RSOS
                royopensci
                Royal Society Open Science
                The Royal Society
                2054-5703
                June 7, 2023
                June 2023
                June 7, 2023
                : 10
                : 6
                : 230235
                Affiliations
                [ 1 ] Center for the Study of Language and Information, Stanford University, , Stanford, CA, USA
                [ 2 ] Department of Psychology, Stanford University, , Stanford, CA, USA
                [ 3 ] Department of Sociology, Stanford University, , Stanford, CA, USA
                [ 4 ] Department of Psychology, Concordia University, , Montreal, Quebec, Canada
                [ 5 ] Department of Psychology, University of British Columbia, , Vancouver, British Columbia, Canada
                [ 6 ] Department of Psychology, University of Manitoba, , Winnipeg, Manitoba, Canada
                Author notes

                Electronic supplementary material is available online at https://doi.org/10.6084/m9.figshare.c.6662773.

                Author information
                http://orcid.org/0000-0001-5032-5995
                https://orcid.org/0000-0002-6595-0969
                https://orcid.org/0000-0002-7040-2510
                https://orcid.org/0000-0002-7551-4378
                https://orcid.org/0000-0001-6173-9878
                https://orcid.org/0000-0003-3212-5775
                https://orcid.org/0000-0003-4275-9798
                https://orcid.org/0000-0003-3404-6472
                https://orcid.org/0000-0001-7570-123X
                http://orcid.org/0000-0001-8583-5610
                Article
                rsos230235
                10.1098/rsos.230235
                10245199
                802c6c27-9bc9-4b94-aeca-8edf77be110f
                © 2023 The Authors.

                Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited.

                History
                : March 1, 2023
                : May 15, 2023
                Funding
                Funded by: John Templeton Foundation, http://dx.doi.org/10.13039/100000925;
                Award ID: 62295
                Funded by: SSHRC;
                Award ID: 752-2022-2189
                Award ID: GR019187
                Categories
                1001
                205
                Psychology and Cognitive Neuroscience
                Research Articles

                big team science,science of team science,meta-science,collaboration

                Comments

                Comment on this article