Standard surgical training has traditionally been one of apprenticeship, where the surgical trainee learns to perform surgery under the supervision of a trained surgeon. This is time‐consuming, costly, and of variable effectiveness. Training using a virtual reality simulator is an option to supplement standard training. Virtual reality training improves the technical skills of surgical trainees such as decreased time for suturing and improved accuracy. The clinical impact of virtual reality training is not known.
To assess the benefits (increased surgical proficiency and improved patient outcomes) and harms (potentially worse patient outcomes) of supplementary virtual reality training of surgical trainees with limited laparoscopic experience.
We searched the Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library, MEDLINE, EMBASE and Science Citation Index Expanded until July 2012.
We included all randomised clinical trials comparing virtual reality training versus other forms of training including box‐trainer training, no training, or standard laparoscopic training in surgical trainees with little laparoscopic experience. We also planned to include trials comparing different methods of virtual reality training. We included only trials that assessed the outcomes in people undergoing laparoscopic surgery.
Two authors independently identified trials and collected data. We analysed the data with both the fixed‐effect and the random‐effects models using Review Manager 5 analysis. For each outcome we calculated the mean difference (MD) or standardised mean difference (SMD) with 95% confidence intervals based on intention‐to‐treat analysis.
We included eight trials covering 109 surgical trainees with limited laparoscopic experience. Of the eight trials, six compared virtual reality versus no supplementary training. One trial compared virtual reality training versus box‐trainer training and versus no supplementary training, and one trial compared virtual reality training versus box‐trainer training. There were no trials that compared different forms of virtual reality training. All the trials were at high risk of bias. Operating time and operative performance were the only outcomes reported in the trials. The remaining outcomes such as mortality, morbidity, quality of life (the primary outcomes of this review) and hospital stay (a secondary outcome) were not reported.
Virtual reality training versus no supplementary training: The operating time was significantly shorter in the virtual reality group than in the no supplementary training group (3 trials; 49 participants; MD ‐11.76 minutes; 95% CI ‐15.23 to ‐8.30). Two trials that could not be included in the meta‐analysis also showed a reduction in operating time (statistically significant in one trial). The numerical values for operating time were not reported in these two trials. The operative performance was significantly better in the virtual reality group than the no supplementary training group using the fixed‐effect model (2 trials; 33 participants; SMD 1.65; 95% CI 0.72 to 2.58). The results became non‐significant when the random‐effects model was used (2 trials; 33 participants; SMD 2.14; 95% CI ‐1.29 to 5.57). One trial could not be included in the meta‐analysis as it did not report the numerical values. The authors stated that the operative performance of virtual reality group was significantly better than the control group.
Virtual reality training versus box‐trainer training: The only trial that reported operating time did not report the numerical values. In this trial, the operating time in the virtual reality group was significantly shorter than in the box‐trainer group. Of the two trials that reported operative performance, only one trial reported the numerical values. The operative performance was significantly better in the virtual reality group than in the box‐trainer group (1 trial; 19 participants; SMD 1.46; 95% CI 0.42 to 2.50). In the other trial that did not report the numerical values, the authors stated that the operative performance in the virtual reality group was significantly better than the box‐trainer group.
Virtual reality training appears to decrease the operating time and improve the operative performance of surgical trainees with limited laparoscopic experience when compared with no training or with box‐trainer training. However, the impact of this decreased operating time and improvement in operative performance on patients and healthcare funders in terms of improved outcomes or decreased costs is not known. Further well‐designed trials at low risk of bias and random errors are necessary. Such trials should assess the impact of virtual reality training on clinical outcomes.
Virtual reality training for supplementing standard training in surgical trainees with limited prior laparoscopic experience
Standard surgical training has traditionally been one of apprenticeship, where the surgical trainee learns to perform the surgery under the supervision of a trained surgeon. This is costly, time‐consuming, and is of variable effectiveness. Laparoscopic surgery involves the use of instruments using keyhole and is generally considered more difficult than open surgery. Training using a virtual reality simulator (computer simulation) is an option to supplement standard laparoscopic surgical training. Virtual reality training improves the technical skills of surgical trainees. The impact of virtual reality training in supplementing standard laparoscopic surgical training in surgical trainees with limited prior laparoscopic experience on patients is not known. We define surgical trainees with limited prior laparoscopic experience as those who have helped senior surgeons in laparoscopic operations and would need supervision for performing laparoscopic operations on their own. We sought to answer the question of whether virtual reality training is useful for such surgical trainees in terms of improving surgical results and for improving the operative performance by performing a thorough search of the medical literature for randomised clinical trials. Randomised clinical trials are commonly called randomised controlled trials and are the best study design to answer such questions. If conducted well, they provide the most accurate answer.
Two authors searched the medical literature available until July 2012 and obtained the information from the identified trials. The use of two authors to identify studies and obtain information decreases the errors in obtaining the information. We identified and included eight trials covering 109 surgical trainees in this review. The trials compared virtual reality with no supplementary training or with box‐trainer training (physical simulator using a camera to display the inside of the box and instruments). There were no trials that compared different forms of virtual reality training. All the trials were at high risk of bias (defects in study design that can lead to arriving at wrong conclusions with overestimation of benefits and underestimation of harms of virtual reality training or standard training). Operating time and operative performance were the only outcomes reported in the trials. The remaining outcomes such as death, complications, quality of life, and hospital stay after the operation were not reported in any of the trials. Overall virtual reality training appears to decrease the operating time (by about 10 minutes) and improve the operative performance of surgical trainees (difficult to quantify from the available reports) with limited laparoscopic experience when compared with no supplementary training or with box‐trainer training. However, the impact of this decreased operating time and improvement in operative performance on patients or healthcare funders in terms of improved health or decreased costs is not known. Further well‐designed trials are necessary, with less risk of arriving at wrong conclusions because of poor study design or because of chance. Such trials should assess the impact of virtual reality training on patients and healthcare funders.