Stephanie L Perkins1, Brooke Krajancich2, Chi-Fu Jeffrey Yang3, Brian A Hargreaves4, Bruce L Daniel5, Mark F Berry6. 1. Department of Radiology, Stanford University School of Medicine, Stanford, California; Department of Bioengineering, Stanford University, Stanford, California. Electronic address: slp979@stanford.edu. 2. Department of Electrical Engineering, Stanford University, Stanford, California. 3. Department of Cardiothoracic Surgery, Stanford University School of Medicine, Stanford, California. 4. Department of Radiology, Stanford University School of Medicine, Stanford, California; Department of Bioengineering, Stanford University, Stanford, California; Department of Electrical Engineering, Stanford University, Stanford, California. 5. Department of Radiology, Stanford University School of Medicine, Stanford, California; Department of Bioengineering, Stanford University, Stanford, California. 6. Department of Cardiothoracic Surgery, Stanford University School of Medicine, Stanford, California. Electronic address: berry037@stanford.edu.
Abstract
PURPOSE: Identifying small lung lesions during minimally invasive thoracic surgery can be challenging. We describe 3-dimensional mixed-reality visualization technology that may facilitate noninvasive nodule localization. DESCRIPTION: A software application and medical image processing pipeline were developed for the Microsoft HoloLens to incorporate patient-specific data and provide a mixed-reality tool to explore and manipulate chest anatomy with a custom-designed user interface featuring gesture and voice recognition. EVALUATION: A needs assessment between engineering and clinical disciplines identified the potential utility of mixed-reality technology in facilitating safe and effective resection of small lung nodules. Through an iterative process, we developed a prototype employing a wearable headset that allows the user to (1) view a patient's original preoperative imaging; (2) manipulate a 3-dimensional rendering of that patient's chest anatomy including the bronchial, osseus, and vascular structures; and (3) simulate lung deflation and surgical instrument placement. CONCLUSIONS: Mixed-reality visualization during surgical planning may facilitate accurate and rapid identification of small lung lesions during minimally invasive surgeries and reduce the need for additional invasive preoperative localization procedures.
PURPOSE: Identifying small lung lesions during minimally invasive thoracic surgery can be challenging. We describe 3-dimensional mixed-reality visualization technology that may facilitate noninvasive nodule localization. DESCRIPTION: A software application and medical image processing pipeline were developed for the Microsoft HoloLens to incorporate patient-specific data and provide a mixed-reality tool to explore and manipulate chest anatomy with a custom-designed user interface featuring gesture and voice recognition. EVALUATION: A needs assessment between engineering and clinical disciplines identified the potential utility of mixed-reality technology in facilitating safe and effective resection of small lung nodules. Through an iterative process, we developed a prototype employing a wearable headset that allows the user to (1) view a patient's original preoperative imaging; (2) manipulate a 3-dimensional rendering of that patient's chest anatomy including the bronchial, osseus, and vascular structures; and (3) simulate lung deflation and surgical instrument placement. CONCLUSIONS: Mixed-reality visualization during surgical planning may facilitate accurate and rapid identification of small lung lesions during minimally invasive surgeries and reduce the need for additional invasive preoperative localization procedures.
Authors: Ningcheng Li; Jonathan Wakim; Yilun Koethe; Timothy Huber; Ryan Schenning; Terence P Gade; Stephen J Hunt; Brian J Park Journal: Radiol Med Date: 2022-06-23 Impact factor: 6.313