News

First Augmented Reality Solution For Hololens Cleared By The Fda

Preoperative clearance for augmented reality usage in surgical planning gives physicians access to a new solution that can improve surgical procedures by enhancing accuracy and shortening operative times.

Tags

Member editorial board ICT&health

Artur Olesch

Share this article

Solution based on augmented reality and Microsoft’s HoloLens allows doctors to see the patient and into the patient simultaneously. Also multiple HoloLens headsets can be worn among users for training or clinical purposes

Novarad’s OpenSight Augmented Reality System is the first AR medical solution for Microsoft HoloLens cleared by the FDA receiving 510(k) clearance for use in pre-operative surgical planning. The technology renders 2D, 3D and 4D images of patients interactively, while accurately overlaying them directly onto the patient’s body. The solution, along with patented virtual tool technology and an integrated targeting system, allows doctors to see the patient and into the patient simultaneously to more accurately plan surgery. The internal visualization can now be achieved without the surgeon ever making an incision.

“This is transformative technology that will unite preoperative imaging with augmented reality to improve the precision, speed and safety of medical procedures,” stated Dr. Wendell Gibby, Novarad CEO and co-creator of OpenSight.

Better understanding of anatomic relationships

The innovation utilizes the Microsoft HoloLens headset that not only allows one to see the 3D patient images in augmented reality (AR), but also to see the patient (reality) at the same time. Augmented reality also lets you see your complete real-world surroundings, avoiding the disorientation of virtual reality. This way the invention allows a much better understanding of anatomic relationships because the images are co-localized to the patient. Pre-operative planning with OpenSight makes it possible to highlight relevant anatomy and critical structures to avoid, as well as positioning virtual tools and guidance systems to more accurately plan a surgical approach. Multiple headsets can be shared among users improving the training of less experienced residents. A teaching version of the software is also available that allows medical students to perform virtual dissections on cadavers.

The new technology specifically utilizes the Microsoft HoloLens headset that allows simultaneous visualization of the 3D patient images in AR and the actual patient and their real-world surroundings. The technique may decrease operative times and improve surgical planning and the understanding of anatomic relationships.

Augmented and mixed reality is changing the game for healthcare

The mission of HoloLens is to bring people, places, and objects from the physical and digital worlds together. Interacting with 3D images in mixed reality enables to visualize and work with digital content as part of the real world. Novarad’s OpenSight is the first solution for HoloLens cleared by the FDA, but not the only one of its kind. For example, CAE VimedixAR is an ultrasound simulator to integrate HoloLens. Healthcare professionals can display, enlarge, turn, and rotate realistic-looking anatomical parts, or command them to return into the manikin body. Users and those learning with this technology are able to witness (in real time) the ultrasound beam as it cuts through human anatomy.