Close this search box.

Augmented Reality to improve accuracy of surgeries

European scientists are developing a Augmented Reality surgical visor in order to improve the accuracy of surgeries. The head-mounted device shows a patient’s medical and anaesthetic data and x-ray directly onto the patient’s body, thus making it unnecessary for surgeons to look away during surgery. This reduces the time spent in surgery by over twenty minutes for every three hours and makes surgeries more accurate.

The department of Information Engineering at the University of Pisa coordinated the research and development of the new device, named VOSTARS. The abbreviation stands for ‘Video Optical See-Through Augmented Reality surgical System’, which is exactly what the device strives to achieve. While wearing the head-mounted display system, surgeons are able to see a patient’s x-ray’s and data in real time, projected onto the patient’s body. This makes it possible to improve surgeries and reduce the amount of time spent in surgery. Reducing the time spent in surgery also means the patients doesn’t have to spent as much time under anaesthetic.

The VOSTARS project received a grant of €3,816,440 from Horizon 2020 via the Photonics Public Private Partnership.

Merging realtime footage with medical data

Before stepping into surgery, the surgeon places the device on his or her head. During surgery, the front facing camera of the VOSTARS system captures what the surgeons sees. The system then ‘merges’ this footage of reality with the patient’s medical images, from CT, MRI, or 3DUS scans. The surgeon then sees the compiled hybrid image on the surgical ‘dashboard’. The visor also presents a patient’s anaesthetic data, heart rate, body temperature, blood pressure, and breathing rates into the surgeon’s field of vision, in a drive to increase accuracy by focusing on the operation and reduce time by never having to look away. A clinician can move freely while still seeing the patient, the hybrid x-ray image and all of critical data all at once in a surgical ‘dashboard’ inside the screen.

Combining approaches

There are currently two types of AR headsets approaches: video see-through (VST) system and optical see-through (OST). The scientists of VOSTARS combine these approaches to get the benefits of both. In ‘optical see-through’ (OST) systems, computer-generated images are superimposed on a user’s field of vision. The user however does have a direct view of the natural environment. The app Pokémon Go is an example of this approach, where small amounts of the virtual world are added to the real world. With ‘video see-through’ (VST) systems, the user experiences life through screens. The user is truly submerged in the virtual world. Occolus Rift uses this approach, where the virtual takes over the real world.

For this project, however, a combination had to be made. Both approaches weren’t suitable for operating on a real patient. OST brings the more naturalistic feel, while VST offers fluid interaction with the world around the user. To achieve this, the researchers had to make a new hybrid from scratch.

VOSTARS aims to have a working prototype of the hybrid device ready for May of 2018. Initially being trialled on a number of procedures to the head, the project hopes to be available to end users in 3 years, with mass production by 2022.


ICT&health World Conference 2024

Experience the future of healthcare at the ICT&health World Conference from May 14th to 16th, 2024!
Secure your ticket now and immerse yourself in groundbreaking technologies and innovative solutions.
Engage with fellow experts and explore the power of global collaborations.

Share this article!

Read also
Innovation Adoption: How to Traverse The Valleys of Death
Pioneering Cardiac Arrest Detection for Enhanced Survival.
CardioWatch Revolutionizes Cardiac Arrest Detection
Dr. Oscar Díaz-Cambronero, Head of Perioperative Medicine Department at La Fe Hospital, spearheads innovative telemonitoring initiatives revolutionizing patient care
Smartwatches Saving Lives Inside and Outside the Hospital
EIT 2024
EIT Awards 2024. Two European startups are revolutionizing the treatment of cardiovascular diseases
Bertrand Piccard, Swiss explorer and founder of the Solar Impulse Foundation
EIT Summit 2024. What are the trigger points that drive or inhibit innovation?
MMC pioneers wireless monitoring for premature infants with the innovative Bambi Belt, revolutionizing care with improved comfort and mobility.
Wireless Monitoring of Vital Signs in Premature Infants at Máxima MC
Data protection-critical incidents resulting from human error are often rooted in stress, routine, negative attitudes toward IT, and deficits in employees' identification with the healthcare facility.
How cyberpsychology helps prevent human errors leading to data leaks
What technologies will enter our homes in a few months? ICT&health checked it out at the CES 2024.
CES 2024: Meet the exciting innovations for health and well-being
An article on a new study on e-health assessment tools
eHealth success lies at the intersection of technology, people, and organization
Unlocking the Future: Professor Sylvia Thun, a trailblazer in healthcare interoperability, discusses the crucial role of seamless data exchange in revolutionizing medicine and empowering individuals with comprehensive access to their health data.
Seamless data exchange will unlock the long-awaited benefits of digitalization
Follow us