Skip to main navigation Skip to search Skip to main content

Multi-User Surgical Navigation Platform Based on Mixed Reality

  • Shin Yan Chiou
  • , Tao Ming Liu
  • , Hao Li Liu*
  • *Corresponding author for this work
  • National Taiwan University

Research output: Contribution to journalJournal Article peer-review

1 Scopus citations

Abstract

Extended Reality (XR) technology enables visualization of patient data during surgery, with Augmented Reality (AR) systems offering 2D or 3D navigation. However, current systems face limitations such as lack of depth in 2D navigation, restricted single-user functionality in 3D navigation, and limited interoperability between tracking markers and navigation platforms. Additionally, users cannot interact with virtual objects, reducing operational efficiency and intuitiveness. This study addresses these issues by proposing a multi-user Mixed Reality (MR) guidance platform that provides interactive, real-time feedback and enhances collaboration. The platform maps 3D medical models onto real-world objects using 2D marker calibration, supporting focused ultrasound for transcranial brain therapy. Integration with BrainLab and HoloLens 2 achieved a single-user positioning accuracy of 0.576±0.294±with multi-user alignment errors averaging 2.718±1.335 mm. The system maintained a frame rate of 50-60 FPS, demonstrating robust performance and precision.

Original languageEnglish
Pages (from-to)162522-162535
Number of pages14
JournalIEEE Access
Volume12
DOIs
StatePublished - 2024

Bibliographical note

Publisher Copyright:
© 2013 IEEE.

Publisher Copyright:
© 2024 The Authors.

Keywords

  • 3D ultrasound visualization
  • HoloLens 2
  • Mixed reality navigation
  • multi-user collaboration
  • surgical guidance system

Fingerprint

Dive into the research topics of 'Multi-User Surgical Navigation Platform Based on Mixed Reality'. Together they form a unique fingerprint.

Cite this