Phantom model and scoring system to assess ability in ultrasound-guided chest drain positioning

Background: Chest tube positioning is an invasive procedure associated with potentially serious injuries. In the last few years, we have been running a project directed at developing a practical simulator of a surgical procedure taught on our medical training program. The phantom model reconstructs the pleural anatomy, visible by lung ultrasound, used for the assessed performance of the Seldinger technique. The aim of the present study was to investigate the validity of this simulation technology for assessing residents in anesthesia and intensive care medicine; specifically, their skill in positioning a US-guided chest tube drain was tested using the simulator device. The second aim of the paper was to evaluate the learning curve of our residents over their 5-year study course and validate the phantom scoring system. Methods: This was a prospective, single-blinded observational study. Participants were recruited from residents in anesthesia and intensive care medicine and divided into two groups: ‘Novice’ and ‘Expert,’ based on the course year attended (years 1, 2, and 3 vs. years 4 and 5, respectively). We asked them to position a chest tube drain in a phantom model, guided by ultrasound, to drain a simulated pleural effusion. Each subject performed two tests that simulated pleural effusions of 4 and 2 cm, respectively. Every step of the maneuver was constantly monitored and the performance scored by the investigators. We then performed a Spearman correlation analysis to evaluate the effect of experience level on the performance of the two groups of residents. Results: Thirty-one residents were included in this study: 20 in the Novice group and 11 in the Expert group. The mean performance rating score was 0.75 ± 4.38 for the Novice Group and 5.91 ± 3.75 for the Expert group (p = 0.0026). The Spearman correlation analysis examining the relationship between year of residency and performance rating score confirmed a positive correlation (r = 0.58, p = 0.0006). Post-test trend analysis revealed a statistically significant linear trend for skill growth across time, i.e., course year (p = 0.0022). Conclusions: Our simulated procedure using a phantom model of lung anatomy can accurately and reliably be used to assess the skill levels of operators in their ability to drain pleural effusion.