A novel augmented reality system for displaying inferior alveolar nerve bundles in maxillofacial surgery

Abstract

Augmented reality systems can combine virtual images with a real environment to ensure accurate surgery with lower risk. This study aimed to develop a novel registration and tracking technique to establish a navigation system based on augmented reality for maxillofacial surgery. Specifically, a virtual image is reconstructed from CT data using 3D software. The real environment is tracked by the augmented reality (AR) software. The novel registration strategy that we created uses an occlusal splint compounded with a fiducial marker (OSM) to establish a relationship between the virtual image and the real object. After the fiducial marker is recognized, the virtual image is superimposed onto the real environment, forming the “integrated image” on semi-transparent glass. Via the registration process, the integral image, which combines the virtual image with the real scene, is successfully presented on the semi-transparent helmet. The position error of this navigation system is 0.96 ± 0.51 mm. This augmented reality system was applied in the clinic and good surgical outcomes were obtained. The augmented reality system that we established for maxillofacial surgery has the advantages of easy manipulation and high accuracy, which can improve surgical outcomes. Thus, this system exhibits significant potential in clinical applications.

Augmented reality for narrow area navigation in jaw surgery: Modified tracking by detection volume subtraction algorithm

“…This experiment showed the reliability and accuracy of stereo‐camera navigation systems for enhancing the application of AR navigation systems for clinician training and patient communication. Zhu et al used a novel registration and tracking technique based on occlusal relationships to improve the accuracy of the state‐of‐the‐art (SOBA) solution which was originally proposed by Scuderi et al to avoid damage to important internal structures through precision during AR navigation‐based surgery of maxillofacial areas. The authors used a virtual image acquisition technique to add more navigational information to be displayed during surgery followed by model manufacturing.…”

A novel rotation invariant and Manhattan metric–based pose refinement: Augmented reality–based oral and maxillofacial surgery

“…So, we do not wish to work with the trackers in our system. Zhu et al implemented a novel registration and tracking technique to find out the occlusal relationship between the virtual images and real images. It was done by the 3D software, Appling 3D reconstruction, and fiducial marker (compounded with occlusal splint).…”

A novel rotational matrix and translation vector algorithm: geometric accuracy for augmented reality in oral and maxillofacial surgeries

“…One of these is a head‐mounted wearable see‐through device, developed by Badiali et al It uses reference markers and a point‐based registration method to reduce the overlay error although the authors failed to focus on the removal of fluctuations and have not provided any solution if the patient or instrument moves. Zhu et al focused on improving the removal of occlusions by presenting an Occlusal splint combined with a fiducial marker, i.e. a registration system, and Bouchard et al used a marker‐based registration method that helps to track the position after occlusion.…”