切换至 "中华医学电子期刊资源库"

中华肝脏外科手术学电子杂志 ›› 2025, Vol. 14 ›› Issue (01) : 13 -17. doi: 10.3877/cma.j.issn.2095-3232.2025005

述评

增强现实、虚拟现实与混合现实在腔镜肝脏外科中的应用
彭子洋1,2, 王志博1,2, 巴赫3, 颜彦3, 彭浩茜3, 李宇4, 刘学民4, 向俊西4, 吴荣谦1,2, 吕毅1,2,3,4,()   
  1. 1.710061 西安交通大学第一附属医院精准外科与再生医学国家地方联合工程研究中心
    2.710049 西安交通大学未来技术学院
    3.710061 西安交通大学医学部
    4.710061 西安交通大学第一附属医院肝胆外科
  • 收稿日期:2024-11-11 出版日期:2025-02-10
  • 通信作者: 吕毅
  • 基金资助:
    国家自然科学基金重大研究计划项目(92048202)国家自然科学基金面上项目(82471190)陕西省重点研发计划项目(2022ZDLSF04-09)陕西省自然科学基础研究计划项目(2021JM-268)陕西省重点研发计划高校联合项目重点项目(2020GXLH-Z-001)西安交通大学自由探索与创新项目(xzy022023069,xzy022024026)

Application of augmented reality, virtual reality and mixed reality in laparoscopic liver surgery

Ziyang Peng1,2, Zhibo Wang1,2, He Ba3, Yan Yan3, Haoqian Peng3, Yu Li4, Xuemin Liu4, Junxi Xiang4, Rongqian Wu1,2, Yi Lyu1,2,3,4,()   

  1. 1.National and Local Joint Engineering Research Center for Precision Surgery and Regenerative Medicine,the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an 710061, China
    2.School of Future Technology, Xi'an Jiaotong University, Xi'an 710049, China
    3.Xi'an Jiaotong University Health Science Center, Xi'an 710061, China
    4.Department of Hepatobiliary Surgery, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an 710061, China
  • Received:2024-11-11 Published:2025-02-10
  • Corresponding author: Yi Lyu
引用本文:

彭子洋, 王志博, 巴赫, 颜彦, 彭浩茜, 李宇, 刘学民, 向俊西, 吴荣谦, 吕毅. 增强现实、虚拟现实与混合现实在腔镜肝脏外科中的应用[J/OL]. 中华肝脏外科手术学电子杂志, 2025, 14(01): 13-17.

Ziyang Peng, Zhibo Wang, He Ba, Yan Yan, Haoqian Peng, Yu Li, Xuemin Liu, Junxi Xiang, Rongqian Wu, Yi Lyu. Application of augmented reality, virtual reality and mixed reality in laparoscopic liver surgery[J/OL]. Chinese Journal of Hepatic Surgery(Electronic Edition), 2025, 14(01): 13-17.

随着腹腔镜技术和理念的进步、器械设备的更新以及对肝脏解剖学认知的不断深入,近年来,腹腔镜肝脏外科发展迅速。目前医学与人工智能技术不断深度融合,增强现实(AR)、虚拟现实(VR)、混合现实(MR)这类新兴技术总称的扩展现实(XR)在医学领域的潜在应用日益受到重视。尤其是在精准医疗发展的关键方向——术中成像配准方面,XR 未来或许会为腔镜肝脏外科手术带来前所未有的创新。

In recent years, laparoscopic liver surgery has developed rapidly along with the progress in laparoscopic technology and concept, equipment and device updates and deepening understanding of liver anatomy.At present, the integration of medicine and artificial intelligence technology has been increasingly strengthened.The potential application of emerging technology extended reality (XR) including augmented reality (AR), virtual reality (VR) and mixed reality (MR) in the field of medicine has captivated widespread attention.Especially in the intraoperative imaging registration, which is the key development direction of precision medicine.XR may bring unprecedented innovation to endoscopic liver surgery in the future.

图1 基于AR 技术的术中荧光腔镜三维影像显像配准 注:AR 为增强现实
图2 XR 辅助术中血管及器械智能识别搭配术前重建识别脉管系统 注:a 为术中肝中静脉投射成像,b 为术中肝中静脉及其伴行血管投射成像;XR 为扩展现实
[1]
Kitagawa M, Sugimoto M, Haruta H, et al.Intraoperative holography navigation using a mixed-reality wearable computer during laparoscopic cholecystectomy[J].Surgery, 2022, 171(4):1006-1013.
[2]
Wu M, Bao S, Yang S.The evolution of anatomical hepatectomy: past,present, and future[J].iLIVER, 2022, 1(3):199-204.
[3]
Brunt LM, Deziel DJ, Telem DA, et al.Safe cholecystectomy multisociety practice guideline and state of the art consensus conference on prevention of bile duct injury during cholecystectomy[J].Ann Surg,2020, 272(1):3-23.
[4]
Rystedt JML, Wiss J, Adolfsson J, et al.Routine versus selective intraoperative cholangiography during cholecystectomy: systematic review, meta-analysis and health economic model analysis of iatrogenic bile duct injury[J].BJS Open, 2021, 5(2): zraa032.
[5]
Zhang X, Otoo EM, Fan Y, et al.Autostereoscopic 3D augmented reality navigation for laparoscopic surgery: a preliminary assessment[J].IEEE Trans Biomed Eng, 2023, 70(4):1413-1421.
[6]
Tinguely P, Fusaglia M, Freedman J, et al.Laparoscopic image-based navigation for microwave ablation of liver tumors-a multi-center study[J].Surg Endosc, 2017, 31(10):4315-4324.
[7]
Keating TC, Jacobs JJ.Augmented reality in orthopedic practice and education[J].Orthop Clin North Am, 2021, 52(1):15-26.
[8]
Acidi B, Ghallab M, Cotin S, et al.Augmented reality in liver surgery[J].J Visc Surg, 2023, 160(2):118-126.
[9]
Gholizadeh M, Bakhshali MA, Mazlooman SR, et al.Minimally invasive and invasive liver surgery based on augmented reality training:a review of the literature[J].J Robot Surg, 2023, 17(3):753-763.
[10]
Yasuda J, Okamoto T, Onda S, et al.Novel navigation system by augmented reality technology using a tablet PC for hepatobiliary and pancreatic surgery[J].Int J Med Robot, 2018, 14(5): e1921.
[11]
Douglas DB, Wilke CA, Gibson D, et al.Virtual reality and augmented reality: advances in surgery[J].Biol Eng Med, 2017, 3(1):1-8.
[12]
Bernhardt S, Nicolau SA, Soler L, et al.The status of augmented reality in laparoscopic surgery as of 2016[J].Med Image Anal, 2017,37:66-90.
[13]
Hagopian EJ.Liver ultrasound: a key procedure in the surgeon's toolbox[J].J Surg Oncol, 2020, 122(1):61-69.
[14]
Quero G, Lapergola A, Soler L, et al.Virtual and augmented reality in oncologic liver surgery[J].Surg Oncol Clin N Am, 2019, 28(1):31-44.
[15]
Schneider C, Thompson S, Totz J, et al.Comparison of manual and semi-automatic registration in augmented reality image-guided liver surgery: a clinical feasibility study[J].Surg Endosc, 2020,34(10):4702-4711.
[16]
Zhang W, Zhu W, Yang J, et al.Augmented reality navigation for stereoscopic laparoscopic anatomical hepatectomy of primary liver cancer: preliminary experience[J].Front Oncol, 2021, 11:663236.
[17]
Pratt P, Ives M, Lawton G, et al.Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels[J].Eur Radiol Exp, 2018,2(1):2.
[18]
Barré J, Michelet D, Truchot J, et al.Virtual reality single-port sleeve gastrectomy training decreases physical and mental workload in novice surgeons: an exploratory study[J].Obes Surg, 2019, 29(4):1309-1316.
[19]
Rowe SP, Chu LC, Fishman EK.3D CT cinematic rendering of the spleen: potential role in problem solving[J].Diagn Interv Imaging,2019, 100(9):477-483.
[20]
Pietrabissa A, Marconi S, Negrello E, et al.An overview on 3D printing for abdominal surgery[J].Surg Endosc, 2020, 34(1):1-13.
[21]
Jin C, Dai L, Wang T.The application of virtual reality in the training of laparoscopic surgery: a systematic review and meta-analysis[J].Int J Surg, 2021, 87:105859.
[22]
Boedecker C, Huettl F, Saalfeld P, et al.Using virtual 3D-models in surgical planning: workflow of an immersive virtual reality application in liver surgery[J].Langenbeck's Arch Surg, 2021, 406(3): 911-915.
[23]
Ahmed F, Jahagirdar V, Gudapati S, et al.Three-dimensional visualization and virtual reality simulation role in hepatic surgery:further research warranted[J].World J Gastrointest Surg, 2022,14(7):723-726.
[24]
Loy Rodas N, Barrera F, Padoy N.See it with your own eyes:markerless mobile augmented reality for radiation awareness in the hybrid room[J].IEEE Trans Biomed Eng, 2017, 64(2):429-440.
[1] 李洋, 蔡金玉, 党晓智, 常婉英, 巨艳, 高毅, 宋宏萍. 基于深度学习的乳腺超声应变弹性图像生成模型的应用研究[J/OL]. 中华医学超声杂志(电子版), 2024, 21(06): 563-570.
[2] 杨敬武, 周美君, 陈雨凡, 李素淑, 何燕妮, 崔楠, 刘红梅. 人工智能超声结合品管圈活动对低年资超声医师甲状腺结节风险评估能力的作用[J/OL]. 中华医学超声杂志(电子版), 2024, 21(05): 522-526.
[3] 明昊, 肖迎聪, 巨艳, 宋宏萍. 乳腺癌风险预测模型的研究现状[J/OL]. 中华乳腺病杂志(电子版), 2024, 18(05): 287-291.
[4] 叶莉, 杜宇. 深度学习在牙髓根尖周病临床诊疗中的应用[J/OL]. 中华口腔医学研究杂志(电子版), 2024, 18(06): 351-356.
[5] 吕玥彤, 靳梦圆, 周大为, 叶啟发. 机器人辅助下肾移植的临床进展与争议[J/OL]. 中华移植杂志(电子版), 2024, 18(04): 242-246.
[6] 熊鹰, 林敬莱, 白奇, 郭剑明, 王烁. 肾癌自动化病理诊断:AI离临床还有多远?[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2024, 18(06): 535-540.
[7] 李伟, 宋子健, 赖衍成, 周睿, 吴涵, 邓龙昕, 陈锐. 人工智能应用于前列腺癌患者预后预测的研究现状及展望[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2024, 18(06): 541-546.
[8] 黄俊龙, 李文双, 李晓阳, 刘柏隆, 陈逸龙, 丘惠平, 周祥福. 基于盆底彩超的人工智能模型在女性压力性尿失禁分度诊断中的应用[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2024, 18(06): 597-605.
[9] 莫淇舟, 苏劲, 黄健, 李健维, 李思宁, 柳建军. 智能控压输尿管软镜碎石吸引取石术在直径10~25 mm上尿路结石中的应用[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2024, 18(05): 497-502.
[10] 李义亮, 苏拉依曼·牙库甫, 麦麦提艾力·麦麦提明, 克力木·阿不都热依木. 机器人与腹腔镜食管裂孔疝修补术联合Nissen 胃底折叠术短期疗效分析[J/OL]. 中华疝和腹壁外科杂志(电子版), 2024, 18(05): 512-517.
[11] 蔡玉琳, 牛丹, 马丹, 王爽. 不同CT 重建算法对人工智能肺结节诊断的意义[J/OL]. 中华肺部疾病杂志(电子版), 2024, 17(06): 931-935.
[12] 赵毅, 李昶田, 唐文博, 白雪婷, 刘荣. 腹腔镜术中超声主胰管自动识别模型的临床应用[J/OL]. 中华腔镜外科杂志(电子版), 2024, 17(05): 290-294.
[13] 张宗明, 董家鸿, 何小东, 王秋生, 徐智, 刘立民, 张翀. 老年胆道外科热点问题的争议与思考[J/OL]. 中华肝脏外科手术学电子杂志, 2024, 13(06): 754-762.
[14] 孙铭远, 褚恒, 徐海滨, 张哲. 人工智能应用于多发性肺结节诊断的研究进展[J/OL]. 中华临床医师杂志(电子版), 2024, 18(08): 785-790.
[15] 杨松林, 黄仕豪, 王丽珠, 李禧萌, 邹飞翔, 李坤炜, 梁明柱, 陈炳辉. 良性肺结节生长变化的影像学评价[J/OL]. 中华介入放射学电子杂志, 2024, 12(04): 344-350.
阅读次数
全文


摘要