Evaluation of Nurse Practitioners' Professional Competence and Comparison of Assessments Using Multiple Methods: Self-Assessment, Peer Assessment, and Supervisor Assessment

Physician questionnaires are commonly used in health services research; however, many survey studies are limited by low response rate. We describe the effectiveness of a method to maximize survey response without using incentives, the effectiveness of survey reminders over time, and differences in response rates based on survey mode and primary care specialty. As part of a study to assess vaccine policy issues, 13 separate surveys were conducted by internet and mail over the period of 2008 to 2013. Surveys were conducted among pre-recruited networks of pediatricians, family physicians and general internists. Each network was active for 2 years and responded to 3–6 surveys. Physicians who indicated preference to respond through an online survey received up to 9 e-mailed requests to complete the questionnaire and up to 2 mailed questionnaires. Physicians who chose to respond by mail received up to 3 mailed questionnaires and a reminder postcard. For 6 of the 13 surveys conducted over the 6 year period, an additional mailing using a hand-addressed envelope was mailed to non-responders at the end of the usual protocol. Effectiveness of survey methods was measured by response rates. The overall response rates varied from 66‒83%. Response rates declined 17 percentage-points on average between the first and last surveys administered within each physician network. The internet group consistently had higher response rates than the mail group (74% vs. 62% on average). An additional mailing in a hand-written envelope boosted the final response rate by 11 percentage-points. Self-selection of survey mode, multiple reminders, and hand-written envelopes are effective methods for maximizing response rates in physician surveys.

Advanced practitioners including nurse practitioners and physician assistants are contributing to care for critically ill patients in the intensive care unit through their participation on the multidisciplinary team and in collaborative physician practice roles. However, the impact of nurse practitioners and physician assistants in the intensive care unit setting is not well known. To identify published literature on the role of nurse practitioners and physician assistants in acute and critical care settings; to review the literature using nonquantitative methods and provide a summary of the results to date incorporating studies assessing the impact and outcomes of nurse practitioner and physician assistant providers in the intensive care unit; and to identify implications for critical care practice. We conducted a systematic search of the English-language literature of publications on nurse practitioners and physician assistants utilizing Ovid MEDLINE, PubMed, and the Cumulative Index of Nursing and Allied Health Literature databases from 1996 through August 2007. None. Over 145 articles were reviewed on the role of the nurse practitioner and physician assistant in acute and critical care settings. A total of 31 research studies focused on the role and impact of these practitioners in the care of acute and critically ill patients. Of those, 20 were focused on nurse practitioner care, six focused on both nurse practitioner and physician assistant care, and five were focused on physician assistant care in acute and critical care settings. Fourteen focused on intensive care unit care, and 17 focused on acute care including emergency room, trauma, and management of patients with specific acute care conditions such as stroke, pneumonia, and congestive heart failure. Most studies used retrospective or prospective study designs and nonprobability sampling techniques. Only two randomized control trials were identified. The majority examined the impact of care on patient care management (n = 17), six focused on comparisons of care with physician care, five examined the impact of models of care including multidisciplinary and outcomes management models, and three assessed involvement and impact on reinforcement of practice guidelines, education, research, and quality improvement. Although existing research supports the use of nurse practitioners and physician assistants in acute and critical care settings, a low level of evidence was found with only two randomized control trials assessing the impact of nurse practitioner care. Further research that explores the impact of nurse practitioners and physician assistants in the intensive care unit setting on patient outcomes, including financial aspects of care is needed. In addition, information on successful multidisciplinary models of care is needed to promote optimal use of nurse practitioners and physician assistants in acute and critical care settings.

To investigate trends in the evaluation of clinical competence in nursing students and newly qualified nurses over the last 10 years.