92
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Instruments to measure patient experience of healthcare quality in hospitals: a systematic review

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Improving and sustaining the quality of hospital care is an international challenge. Patient experience data can be used to target improvement and research. However, the use of patient experience data has been hindered by confusion over multiple instruments (questionnaires) with unknown psychometric testing and utility.

          Methods

          We conducted a systematic review and utility critique of questionnaires to measure patient experience of healthcare quality in hospitals. Databases (Medical Literature Analysis and Retrieval System (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Psychological Information (PsychINFO) and Web of Knowledge until end of November 2013) and grey literature were scrutinised. Inclusion criteria were applied to all records with a 10 % sample independently checked. Critique included (1) application of COSMIN checklists to assess the quality of each psychometric study, (2) critique of psychometric results of each study using Terwee et al. criteria and (3) development and critique of additional aspects of utility for each instrument. Two independent reviewers completed each critique. Synthesis included combining findings in a utility matrix.

          Results

          We obtained 1157 records. Of these, 26 papers measuring patient experience of hospital quality of care were identified examining 11 international instruments. We found evidence of extensive theoretical/development work. The quality of methods and results was variable but mostly of a high standard. Additional aspects of utility found that (1) cost efficiency was mostly poor, due to the resource necessary to obtain reliable samples; (2) acceptability of most instruments was good and (3) educational impact was variable, with evidence on the ease of use, for approximately half of the questionnaires.

          Conclusions

          Selecting the right patient experience instrument depends on a balanced consideration of aspects of utility, aided by the matrix. Data required for high stakes purposes requires a high degree of reliability and validity, while those used for quality improvement may tolerate lower levels of reliability in favour of other aspects of utility (educational impact, cost and acceptability).

          Systematic review registration

          PROSPERO CRD42013006754

          Electronic supplementary material

          The online version of this article (doi:10.1186/s13643-015-0089-0) contains supplementary material, which is available to authorized users.

          Related collections

          Most cited references76

          • Record: found
          • Abstract: not found
          • Article: not found

          Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.

            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Quality criteria were proposed for measurement properties of health status questionnaires.

            Recently, an increasing number of systematic reviews have been published in which the measurement properties of health status questionnaires are compared. For a meaningful comparison, quality criteria for measurement properties are needed. Our aim was to develop quality criteria for design, methods, and outcomes of studies on the development and evaluation of health status questionnaires. Quality criteria for content validity, internal consistency, criterion validity, construct validity, reproducibility, longitudinal validity, responsiveness, floor and ceiling effects, and interpretability were derived from existing guidelines and consensus within our research group. For each measurement property a criterion was defined for a positive, negative, or indeterminate rating, depending on the design, methods, and outcomes of the validation study. Our criteria make a substantial contribution toward defining explicit quality criteria for measurement properties of health status questionnaires. Our criteria can be used in systematic reviews of health status questionnaires, to detect shortcomings and gaps in knowledge of measurement properties, and to design validation studies. The future challenge will be to refine and complete the criteria and to reach broad consensus, especially on quality criteria for good measurement properties.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study

              Background Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist. Methods A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated ‘agree’ or ‘strongly agree’. Results Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed. Conclusions The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.
                Bookmark

                Author and article information

                Contributors
                01463 255622 , michelle.beattie@stir.ac.uk
                D.Y.Murphy@Dundee.ac.uk
                I.Atherton@napier.ac.uk
                william.lauder@stir.ac.uk
                Journal
                Syst Rev
                Syst Rev
                Systematic Reviews
                BioMed Central (London )
                2046-4053
                23 July 2015
                23 July 2015
                2015
                : 4
                : 97
                Affiliations
                [ ]School of Health Sciences, Centre for Health Science, University of Stirling, Highland Campus, Old Perth Rd, Inverness, IV2 3JH UK
                [ ]Quality, Safety and Informatics Research Group, University of Dundee, Dundee, UK
                [ ]School of Nursing, Midwifery and Social Care, Edinburgh Napier University, Edinburgh, UK
                [ ]School of Health Sciences, University of Stirling, Stirling, UK
                Article
                89
                10.1186/s13643-015-0089-0
                4511995
                26202326
                7da604b9-9afd-44aa-9fcf-3adce1529155
                © Beattie et al. 2015

                This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

                History
                : 13 March 2015
                : 8 July 2015
                Categories
                Research
                Custom metadata
                © The Author(s) 2015

                Public health
                systematic review,patient,experience,satisfaction,quality,hospital,acute care,instruments,questionnaires,surveys,utility

                Comments

                Comment on this article

                scite_

                Similar content183

                Cited by114

                Most referenced authors737