Search
Close this search box.
Search

Augmented Reality to improve accuracy of surgeries

European scientists are developing a Augmented Reality surgical visor in order to improve the accuracy of surgeries. The head-mounted device shows a patient’s medical and anaesthetic data and x-ray directly onto the patient’s body, thus making it unnecessary for surgeons to look away during surgery. This reduces the time spent in surgery by over twenty minutes for every three hours and makes surgeries more accurate.

The department of Information Engineering at the University of Pisa coordinated the research and development of the new device, named VOSTARS. The abbreviation stands for ‘Video Optical See-Through Augmented Reality surgical System’, which is exactly what the device strives to achieve. While wearing the head-mounted display system, surgeons are able to see a patient’s x-ray’s and data in real time, projected onto the patient’s body. This makes it possible to improve surgeries and reduce the amount of time spent in surgery. Reducing the time spent in surgery also means the patients doesn’t have to spent as much time under anaesthetic.

The VOSTARS project received a grant of €3,816,440 from Horizon 2020 via the Photonics Public Private Partnership.

Merging realtime footage with medical data

Before stepping into surgery, the surgeon places the device on his or her head. During surgery, the front facing camera of the VOSTARS system captures what the surgeons sees. The system then ‘merges’ this footage of reality with the patient’s medical images, from CT, MRI, or 3DUS scans. The surgeon then sees the compiled hybrid image on the surgical ‘dashboard’. The visor also presents a patient’s anaesthetic data, heart rate, body temperature, blood pressure, and breathing rates into the surgeon’s field of vision, in a drive to increase accuracy by focusing on the operation and reduce time by never having to look away. A clinician can move freely while still seeing the patient, the hybrid x-ray image and all of critical data all at once in a surgical ‘dashboard’ inside the screen.

Combining approaches

There are currently two types of AR headsets approaches: video see-through (VST) system and optical see-through (OST). The scientists of VOSTARS combine these approaches to get the benefits of both. In ‘optical see-through’ (OST) systems, computer-generated images are superimposed on a user’s field of vision. The user however does have a direct view of the natural environment. The app Pokémon Go is an example of this approach, where small amounts of the virtual world are added to the real world. With ‘video see-through’ (VST) systems, the user experiences life through screens. The user is truly submerged in the virtual world. Occolus Rift uses this approach, where the virtual takes over the real world.

For this project, however, a combination had to be made. Both approaches weren’t suitable for operating on a real patient. OST brings the more naturalistic feel, while VST offers fluid interaction with the world around the user. To achieve this, the researchers had to make a new hybrid from scratch.

VOSTARS aims to have a working prototype of the hybrid device ready for May of 2018. Initially being trialled on a number of procedures to the head, the project hopes to be available to end users in 3 years, with mass production by 2022.

Whixx

ICT&health World Conference 2024

Experience the future of healthcare at the ICT&health World Conference from May 14th to 16th, 2024!
Secure your ticket now and immerse yourself in groundbreaking technologies and innovative solutions.
Engage with fellow experts and explore the power of global collaborations.

Share this article!

Read also
Balancing regulatory compliance with seamless adoption, healthcare navigates the integration of AI solutions.
A guide to implementing AI in healthcare amid the EU AI Act
AmyWebb-Stephen-Olker
Futurist Amy Webb claims that wearables will evolve into "connectables"
Digital health solutions empower patients to better manage their health and integrate care into their daily lives.
How to improve Digital Patient Engagement to streamline workflows
For people with diabetes, inaccurate blood glucose measurements can lead to errors in diabetes management, including taking the wrong dose of insulin, sulfonylureas, or other medications that can rapidly lower blood glucose.
Smartwatches measuring glucose level: Harmful but easy to buy fake innovations
How to introduce innovation and AI in healthcare organizations if there is no business model for prevention and quality – Our interview with Professor Ran Balicer, the Chief Innovation Officer at Clalit Health Services and founding Director of Clalit Research Institute.
I see no legitimate rationale for delaying the digital transformation in healthcare
Pioneering Cardiac Arrest Detection for Enhanced Survival.
CardioWatch Revolutionizes Cardiac Arrest Detection
Dr. Oscar Díaz-Cambronero, Head of Perioperative Medicine Department at La Fe Hospital, spearheads innovative telemonitoring initiatives revolutionizing patient care
Smartwatches Saving Lives Inside and Outside the Hospital
EIT 2024
EIT Awards 2024. Two European startups are revolutionizing the treatment of cardiovascular diseases
Bertrand Piccard, Swiss explorer and founder of the Solar Impulse Foundation
EIT Summit 2024. What are the trigger points that drive or inhibit innovation?
MMC pioneers wireless monitoring for premature infants with the innovative Bambi Belt, revolutionizing care with improved comfort and mobility.
Wireless Monitoring of Vital Signs in Premature Infants at Máxima MC
Follow us