Details

Autor(en) / Beteiligte

• Patel, Amar D.
• Gallagher, Anthony G.
• Nicholson, William J.
• Cates, Christopher U.

Titel

Learning Curves and Reliability Measures for Virtual Reality Simulation in the Performance Assessment of Carotid Angiography

Ist Teil von

• Journal of the American College of Cardiology, 2006-05, Vol.47 (9), p.1796-1802

Ort / Verlag

New York, NY: Elsevier Inc

Erscheinungsjahr

2006

Quelle

Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals

Beschreibungen/Notizen

• Learning Curves and Reliability Measures for Virtual Reality Simulation in the Performance Assessment of Carotid Angiography Amar D. Patel, Anthony G. Gallagher, William J. Nicholson, Christopher U. Cates Virtual reality (VR) simulation training is a required component toward successful attainment of proficiency in carotid stenting. Improvement in operator skills performance was assessed with serial trials of VR-simulated carotid angiography performed by interventional cardiologists. Comparison of the first and last trial showed a significant improvement in procedure time, contrast volume, fluoroscopy time, and most importantly, the dynamic metric of catheter handling errors (CE). The test-retest reliability for CE was high (r = 0.9, p = 0.0001). Furthermore, the internal consistency of the VR simulator was high (alpha = 0.81 to 0.93). Composite catheter handling errors represent a reliable measurable metric for the high stakes assessment of procedural skills. Improvement in performance as measured by metric-based procedural errors must be demonstrated if virtual reality (VR) simulation is to be used as a valid means of proficiency assessment and improvement in procedural-based medical skills. The Food and Drug Administration requires completion of VR simulation training for physicians learning to perform carotid stenting. Interventional cardiologists (n = 20) participating in the Emory NeuroAnatomy Carotid Training program underwent an instructional course on carotid angiography and then performed five serial simulated carotid angiograms on the Vascular Interventional System Trainer (VIST) VR simulator (Mentice AB, Gothenburg, Sweden). Of the subjects, 90% completed the full assessment. Procedure time (PT), fluoroscopy time (FT), contrast volume, and composite catheter handling errors (CE) were recorded by the simulator. An improvement was noted in PT, contrast volume, FT, and CE when comparing the subjects’ first and last simulations (all p < 0.05). The internal consistency of the VIST VR simulator as assessed with standardized coefficient alpha was high (range 0.81 to 0.93), except for FT (alpha = 0.36). Test-retest reliability was high for CE (r = 0.9, p = 0.0001). A learning curve with improved performance was demonstrated on the VIST simulator. This study represents the largest collection of such data to date in carotid VR simulation and is the first report to establish the internal consistency of the VIST simulator and its test-retest reliability across several metrics. These metrics are fundamental benchmarks in the validation of any measurement device. Composite catheter handling errors represent measurable dynamic metrics with high test-retest reliability that are required for the high-stakes assessment of procedural skills.