Preliminary face and construct validation study of a virtual basic laparoscopic skill trainer
- PMID: 20201683
- PMCID: PMC3123729
- DOI: 10.1089/lap.2009.0030
Preliminary face and construct validation study of a virtual basic laparoscopic skill trainer
Abstract
Background: The Virtual Basic Laparoscopic Skill Trainer (VBLaST) is a developing virtual-reality-based surgical skill training system that incorporates several of the tasks of the Fundamentals of Laparoscopic Surgery (FLS) training system. This study aimed to evaluate the face and construct validity of the VBLaST system.
Materials and methods: Thirty-nine subjects were voluntarily recruited at the Beth Israel Deaconess Medical Center (Boston, MA) and classified into two groups: experts (PGY 5, fellow and practicing surgeons) and novice (PGY 1-4). They were then asked to perform three FLS tasks, consisting of peg transfer, pattern cutting, and endoloop, on both the VBLaST and FLS systems. The VBLaST performance scores were automatically computed, while the FLS scores were rated by a trained evaluator. Face validity was assessed using a 5-point Likert scale, varying from not realistic/useful (1) to very realistic/useful (5).
Results: Face-validity scores showed that the VBLaST system was significantly realistic in portraying the three FLS tasks (3.95 +/- 0.909), as well as the reality in trocar placement and tool movements (3.67 +/- 0.874). Construct-validity results show that VBLaST was able to differentiate between the expert and novice group (P = 0.015). However, of the two tasks used for evaluating VBLaST, only the peg-transfer task showed a significant difference between the expert and novice groups (P = 0.003). Spearman correlation coefficient analysis between the two scores showed significant correlation for the peg-transfer task (Spearman coefficient 0.364; P = 0.023).
Conclusions: VBLaST demonstrated significant face and construct validity. A further set of studies, involving improvement to the current VBLaST system, is needed to thoroughly demonstrate face and construct validity for all the tasks.
Figures
Similar articles
-
Preliminary evaluation of the pattern cutting and the ligating loop virtual laparoscopic trainers.Surg Endosc. 2015 Apr;29(4):815-21. doi: 10.1007/s00464-014-3764-7. Epub 2014 Aug 27. Surg Endosc. 2015. PMID: 25159626 Free PMC article. Clinical Trial.
-
Convergent validation and transfer of learning studies of a virtual reality-based pattern cutting simulator.Surg Endosc. 2018 Mar;32(3):1265-1272. doi: 10.1007/s00464-017-5802-8. Epub 2017 Aug 15. Surg Endosc. 2018. PMID: 28812196 Free PMC article. Clinical Trial.
-
Validation of a virtual intracorporeal suturing simulator.Surg Endosc. 2019 Aug;33(8):2468-2472. doi: 10.1007/s00464-018-6531-3. Epub 2018 Oct 17. Surg Endosc. 2019. PMID: 30334151 Free PMC article.
-
Characterizing the learning curve of the VBLaST-PT(©) (Virtual Basic Laparoscopic Skill Trainer).Surg Endosc. 2013 Oct;27(10):3603-15. doi: 10.1007/s00464-013-2932-5. Epub 2013 Apr 10. Surg Endosc. 2013. PMID: 23572217 Free PMC article.
-
Validation of the VBLaST: A Virtual Peg Transfer Task in Gynecologic Surgeons.J Minim Invasive Gynecol. 2015 Nov-Dec;22(7):1271-7. doi: 10.1016/j.jmig.2015.07.015. Epub 2015 Jul 26. J Minim Invasive Gynecol. 2015. PMID: 26216094 Free PMC article.
Cited by
-
Validation of the VBLaST pattern cutting task: a learning curve study.Surg Endosc. 2018 Apr;32(4):1990-2002. doi: 10.1007/s00464-017-5895-0. Epub 2017 Oct 19. Surg Endosc. 2018. PMID: 29052071 Free PMC article. Clinical Trial.
-
Validity evidence for the Fundamentals of Laparoscopic Surgery (FLS) program as an assessment tool: a systematic review.Surg Endosc. 2016 Feb;30(2):512-520. doi: 10.1007/s00464-015-4233-7. Epub 2015 Jun 20. Surg Endosc. 2016. PMID: 26091982 Review.
-
Haptic based fundamentals of laparoscopic surgery simulation for training with objective assessments.Front Robot AI. 2024 May 30;11:1363952. doi: 10.3389/frobt.2024.1363952. eCollection 2024. Front Robot AI. 2024. PMID: 38873121 Free PMC article.
-
Towards virtual FLS: development of a peg transfer simulator.Int J Med Robot. 2014 Sep;10(3):344-55. doi: 10.1002/rcs.1534. Epub 2013 Sep 13. Int J Med Robot. 2014. PMID: 24030904 Free PMC article.
-
Construct validity of a video-tracking system based on orthogonal cameras approach for objective assessment of laparoscopic skills.Int J Comput Assist Radiol Surg. 2016 Dec;11(12):2283-2293. doi: 10.1007/s11548-016-1388-1. Epub 2016 Apr 2. Int J Comput Assist Radiol Surg. 2016. PMID: 27038961
References
-
- Powers TW. Murayama KM. Toyama M. Murphy S. Denham EW., 3rd Derossis AM. Joehl RJ. House staff performance is improved by participation in a laparoscopic skills curriculum. Am J Surg. 2002;184:626–629. - PubMed
-
- Peters JH. Fried GM. Swanstrom LL. Soper NJ. Sillin LF. Schirmer B. Hoffman K. Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery. 2004;135:21–27. and the SAGES FLS Committee. - PubMed
-
- Gallagher AG. Richie K. McClure N. McGuigan J. Objective psychomotor assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg. 2001;25:1478–1483. - PubMed
-
- Grantcharov TP. Bardram L. Funch-Jensen P. Rosenberg J. Learning curves and impact of previous operative experience on performance on a virtual reality simulator to test laparoscopic surgical skills. Am J Surg. 2003;185:146–149. - PubMed
-
- Grantcharov TP. Rosenberg J. Pahle E. Funch-Jensen P. Virtual reality computer simulation. Surg Endosc. 2001;15:242–244. - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Medical