- 33 views
- 60 downloads
High-Resolution Stereoscopic Visualization of Pediatric Echocardiography Data on Microsoft HoloLens 2
-
- Author / Creator
- Selvamanikkam, Meruja
-
Pediatric valve surgery typically requires cardiopulmonary bypass and cardioplegic arrest, which can have adverse effects on both post-operative recovery and long-term neurological function. However, non-bypass surgical techniques have limitations in pediatric patients, particularly due to challenges associated with the use of inserted devices. Balancing the necessity of bypass surgery with the unique considerations of pediatric cases remains a crucial aspect of pediatric valve surgery. Medical imaging, particularly Three-dimensional (3D) ultrasound (US), is crucial in providing volumetric images and detailed anatomical information for diagnosis and surgical planning. It is a key tool in the medical field to obtain a comprehensive view of the body. Ordinary two-dimensional displays do not provide depth perception and are not ideal for representing volumetric data, necessitating the use of more sophisticated visualization methods. Virtual and augmented reality (AR) displays can be used to improve the visualization of medical images, allowing for a more natural interaction with the environment. To address the issue of performing non-bypass surgery in children, a beating heart valve repair technique using augmented reality displays and three-dimensional echocardiography (3DE) is proposed to enhance visualization, offer natural interaction tools and voice commands, and facilitate the widespread use of 3D ultrasound in clinical settings. This study proposes custom software developed using the Unity3D platform to render high-resolution 3DE on the Microsoft HoloLens 2 using a phantom model with internal targets for papillary muscles and the atrioventricular leaflet-annular interface, providing an immersive AR experience for medical professionals. This research focuses on 3DE in children and uses a phantom heart model to mimic a pulsating heart. The volume rendering algorithm utilizes the ray-marching technique, enabling direct volume rendering of high-quality volumetric models. To maintain a satisfactory frame rate, a Holographic Remoting approach is employed to reduce latency and enhance network transmission speed, utilizing the resources of a personal computer (PC). The custom software developed offers voice commands and an intuitive and interactive user interface that allows medical professionals to manipulate and explore 3DE images effectively. The interaction includes the ability to slice, modify the intensity range, and alter the voxel density. The experimental evaluations demonstrate that it is possible to produce a high-quality real-time display with HoloLens 2 and a PC-based remote rendering system, allowing intuitive control and exploration of 3DE. Overall, this research highlights the potential of AR rendering offered through Microsoft HoloLens 2 to advance pediatric 3DE rendering for medical professionals to enhance their decision-making and understanding of medical datasets.
-
- Subjects / Keywords
-
- Graduation date
- Spring 2024
-
- Type of Item
- Thesis
-
- Degree
- Master of Science
-
- License
- This thesis is made available by the University of Alberta Libraries with permission of the copyright owner solely for non-commercial purposes. This thesis, or any portion thereof, may not otherwise be copied or reproduced without the written consent of the copyright owner, except to the extent permitted by Canadian copyright law.