AR / VR as disruptive technologies for medicine

Aug 15, 2018Posted by: Pawel Surgiel

The XX century was a huge step in medicine, not only in the scope of knowledge that was gathered but also in how easily accessible this knowledge is. Today in less than a few seconds we can get access to almost 95% of what mankind knows. The XXI, however, gives us a chance not only to discover, process and share data but to experience and share this experience amongst ourselves.

Why we need this solution?

BIVROST started a project for medical education, that would allow students to participate in surgeries without entering the operation theatre with the use of 180° videos. The development of the solution was greatly encouraged by the low numbers of surgeries experienced by the students of medicine, causing a situation in which only a few of them have enough practical knowledge when they pass their exams. With 180° live streams and videos, the access to the procedures is not limited by the walls of the operating theatre.

The benefits of 180° in the surgical theatre

Live-streamed 180° video allows the student to look around as if participating in the procedure. The important factor is that the focus is moved from the traditional ways of presenting instructional surgical videos. They get access to the far wider perspective allowing the students to see beyond what the main surgeon is looking at. They get the scope of what every member of the surgical team is responsible for and how they perform during different parts of the procedure, letting them notice the switching dynamics and create synergies between them. This kind of solution provides the student with more knowledge than standard videos or book descriptions making them more suitable for any position in the surgical theatre rather than acting on the whim when faced with a certain scenario.

Enhanced values

We can add graphics and interface to the raw footage to provide additional information during the operation. Depending on the procedure, this can include laparoscopic or microscope feeds or even a 3D close-up feed of the area that is being operated on. You can also see the effect of the metrics, such as the heartbeat monitor and blood count, during different stages of the operation. The graphics could be used in strictly educational ways to highlight the important aspects in different parts of the procedure, telling the students to focus their attention on those details or checking whether they noticed them on their own.

Those videos can also be boosted with the use of live commentary from the surgeon or a voiceover guide that describes each aspect of the surgery giving the crucial knowledge to the viewer. The possibilities of enhancing those videos are endless and could be modified depending on the need and purpose of the video.

How to set it up?

The main benefit of a small factor 180° camera is that it takes less space than an average student of medicine and can be placed way closer to the operating table without distracting or disturbing the surgeon. Several cameras can be placed to get a different perspective or angle. When the video is captured we can add overlays to provide students with necessary information. The hardest part of capturing such content is the lack of retakes and forcing the surgeon to unsew somebody just take a better shot. BIVROST technology has the experience in capturing such content.

Why is it so important?

The key to this project is giving every student the opportunity that might not occur throughout their studies. These procedures can be reviewed, talked about during courses creating the debate that drastically lowers its hypothetical level as students talk about their shared experiences gained by using 180° technology. It is a great opportunity for medical universities to expand their syllabi while making it easier and more entertaining for students to learn.