Topology-Aware AR With G3$$ {G}^3 $$-Depth$$ Depth $$ for Minimally Invasive Surgery
Authors: Gao, Q., Tang, W., Wan, T.R.
Journal: Computer Animation and Virtual Worlds
Publication Date: 01/09/2026
Volume: 37
Issue: 5
eISSN: 1546-427X
ISSN: 1546-4261
DOI: 10.1002/cav.70171
Abstract:This study proposes a topology-aware 3D augmented reality (AR) framework for minimally invasive surgery (MIS) and robot-assisted MIS (RAMIS) to address the limited field of view and lack of depth perception in 2D endoscopic imaging. Central to the framework is a novel self-supervised depth estimation method, (Formula presented.) - (Formula presented.), which employs a translation-to-permutation encoder with group equivariance and four-connectivity graph structures to capture non-Euclidean geometric features and generate accurate 3D point clouds, particularly for surgical instruments. The reconstructed depth maps enable real-time AR overlays, Poisson surface-based mesh reconstruction, and precise instrument–organ distance measurement. Extensive evaluation on DaVinci, SCARED, SERV-CT, and Hamlyn heart datasets demonstrates significant performance improvements over state-of-the-art methods, with Abs Rel gains of approximately (Formula presented.) and (Formula presented.). Validation in multiple surgical scenarios confirms enhanced depth perception and reliable spatial awareness, highlighting the framework's potential to improve surgical precision, safety, and clinical outcomes.
Source: Scopus