3D MED-i explores immersive arts-led 3D visualisation approaches using Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) data.
Adherence to rehabilitation from serious stokes, in addition to having a comprehensive understanding of the disease process, is vital to reduce the patient’s risk of further events. Complex two-dimensional CT and MRI scan data, conventionally displayed in serial cross sections, is typically very difficult for untrained observers to decipher, even with the guidance from the treating clinician.
In collaboration with medical experts at the St Vincent’s Hospital Sydney, the team at UNSW are developing novel ways for stroke patients to explore personalised CT and MRI scan data in virtual reality to assist in the rehabilitation process. It is anticipated that with a greater understanding of their disease and a deeper ‘experiential’ connection with their own bodies, patients may increase compliance with rehabilitation and recommended lifestyle changes to lessen the risk of future events.
The group have developed a sophisticated pipeline of data processing that allows patient’s 3D scan data to be converted into a digital structure that is optimised for VR applications. Using art- and design-based principles of visual storytelling with the latest in immersive gaming technology, patients can explore the virtual landscape of their own blood vessels to identify the vascular features that led to the stoke event. This joint research project will investigate whether arts-led 3D digital aesthetics can communicate disease process to patients. The project aims to enrol sufficient numbers of patients for quantitative assessment of the effect of the visualisations on stroke outcomes. It is anticipated that this work will build linkage between experimental 3D computer arts practice and clinical health interventions.
St Vincent’s Hospital Collaborators:
A/Prof Steven Faux, St Vincent’s Hospital
Dr Angelica Thompson Butel, St Vincent’s Hospital & ACU
Dr Christine Shiner, St Vincent’s Hospital
Dr James Ottom, St Vincent’s Hospital
See more in the videos below:
A virtual trip through your own arteries - National Geographic
A gamer's journey through the body - UNSW TV