Augmented reality technology in the surgical treatment of pancreatic neoplasms

Objective. Analysis of the possibility and effectiveness of integrating intraoperative augmented reality into pancreatic surgery.

Materials and methods. A search and selection of publications was conducted in peer-reviewed databases using the key phrases “augmented reality”, “3D modeling”, “surgical visualization”, and “intraoperative technology”. The search was limited to peer-reviewed publications in the English language. The analysis was supplemented by the authors’ own clinical observations of a mucinous cystadenoma of the tail of the pancreas with malignancy. During surgery, the technology of augmented reality with data recording in the Medgital Vision software and hardware complex was used.

Results. Intraoperative augmented reality ensures the possibility of creating a “transparent” anatomy by forming 3D models of the pancreas, neoplasms, and vascular structures in real time. According to most authors, the use of augmented reality improves the visualization of the vascular bed in the surgical field. However, it does not significantly affect the duration of the operation and the amount of blood loss in all situations, which is confirmed by the results of the authors’ own observations.

Conclusion. In order to increase the informative value of augmented reality technology and ensure its widespread application in surgical practice, studies involving large groups of patients are required for selecting markers for accurate spatial registration of 3D models. Augmented reality should be considered an important component of the emerging set of technologies for safe and accurate operations.

1. Bishop M.A., Simo K. Distal pancreatectomy. StartPearls Publishing; 2023 (обновлено 21 июня 2023 г.; процитировано 30 октября 2016 г.). Доступно: https://www.ncbi.nlm.nih.gov/books/NBK564309/1

2. Sandini M., Ruscic K.J., Ferrone C. R., Qadan M., Eikermamm M., Warshaw A.L., Lillemoe K.D., Fernandez-del Castillo C. Major Complications Independently Increase Long-Term Mortality After Pancreatoduodenectomy for Cancer. J. Gastrointest. Surg. 2019; 23 (10): 1984–1990. https://doi.org/10.1007/s11605-018-3939-y2

3. Kondo N., Murakami Y., Uemura K., Nakagawa N., Okada K., Takahashi S., Sueda T. Prognostic impact of postoperative complication after pancreatoduodenectomy for pancreatic adenocarcinoma stratified by the resectability status. J. Surg. Oncol. 2018; 118 (7): 1105–1114. https://doi.org/10.1002/jso.250663

4. Vávra P., Roman J., Zonča P., Ihnát P., Němec M., Kumar J., Habib N., El-Gendi A. Recent development of augmented rea­lity in surgery: a review. J. Healthc. Eng. 2017; 1: 9. https://doi.org/10.1155/2017/4574172

5. Fedorov V.D., Karmazanovskiy G.G., Guzeeva E.B., Tsvirkun V.V. Virtualinoe Hkirurgicheskoe modelirovanie na osnove dannyx komp’yuternoy tomografii [Virtual Surgical Modeling Based on Computed Tomography Data]. Moscow: Vidar, 2003. 184 p. (In Russ.).

6. Alyaev Yu.G., Ternovoy S.K., Akhvelediani N.D., Fiev D.N. Innovative diagnosis of urologic diseases. Vrach (The Doctor). 2010; 6: 2. (In Russ.).

7. Alyaev Yu.G., Ternovoy S.K., Khokhlachev S.B., Akhvelediani N.D., Nagorny M.N., Fiev D.N. Computer modeling in nephronsparing surgeries scheduling for kidney tumor. Bashkortostan Medical Journal. 2010; 2: 29–35.

8. Tang S.L., Kwoh C.K., Teo M.Y., Sing N.W., Ling K.V.. Augmented reality systems for medical applications. IEEE Eng. Med. Biol Mag. 1998; 17 (3): 49–58. https://doi.org/10.1109/51.677169

9. Marescaux J., Michele D., Soler L. Augmented Reality and Minimally Invasive Surgery. J. Gastroenterol. Hepatol. Res. 2013; 2 (5): 555–559. https://doi.org/10.6051/j.issn.2224-3992.2013.02.175

10. Calhoun P.S., Kuszyk B.S., Heath D.G., Carley J.C., Fishman E.K. Three-dimensional volume rendering of spiral CT data: Theory and method. RadioGraphics. 1999; 19 (3): 745–764. https://doi.org/10.1148/radiographics.19.3.g99ma14745

11. Deng W., Li F., Wang M., Song Z. Easy-to-use augmented reality neuronavigation using a wireless tablet PC. Stereotact. Funct. Neurosurg. 2014; 92 (1): 17–24. https://doi.org/10.1159/000354816

12. Inoue D., Cho B., Mori M., Kikkawa Y., Amano T., Nakamizo A., Yoshimoto K., Mizoguchi M., Tomikawa M., Hong J., Hashizume M., Sasaki T. Preliminary study on the clinical application of augmented reality neuronavigation. J. Neurol. Surg. A Cent. Eur. Neurosurg. 2013; 74 (2): 71-76. https://doi.org/ https://doi.org/10.1055/s-0032-1333415

13. Wu H.Q., Geng X.Y., Wang L., Zhang Y.P., Jiang K., Tang L.M., Zhou G.M., Dong J.C. Optical augmented reality assisted navigation system for neurosurgery teaching and planning. Fifth International Conference on Digital Image Processing. 2013; 8878F: 643–647. https://doi.org/10.1117/12.2030573

14. Mahvash M., Tabrizi L.B. A novel augmented reality system of image projection for image-guided neurosurgery. Acta Neurochir. (Wien). 2013; 155: 943–947. https://doi.org/10.1007/s00701-013-1668-2

15. Ivanov V.M., Krivtsov A.M., Strelkov S.V., Kalakutskiy N.V., Yaremenko A.I., Petropavlovskaya M.Yu., Portnova M.N., Lukina O.V., Litvinov A.P. Intraoperative use of mixed reality technology in median neck and branchial cyst excision. Future Internet. 2021; 13 (8): 214; https://doi.org/10.3390/fi13080214

16. Ivanov V.M., Krivtsov A.M., Strelkov S.V., Smirnov A.Yu., Shipov R.Yu., Grebenkov V.G., Rumyantsev V.N., Gheleznyak I.S., Surov D.A., Korzhuk M.S., Koskin V.S. Practical application of augmented/mixed reality technologies in surgery of abdominal cancer patients. J. Imaging. 2022; 8 (7): 183. https://doi.org/10.3390/jimaging8070183

17. Birkmeyer J.D., Finlayson S.R.G., Tosteson A.N.A., Sharp S.M., Warshaw A.L., Fisher E.S. Effect of hospital volume on in-hospital mortality with pancreaticoduodenectomy. Surgery. 1999; 125 (3): 250–256. https://doi.org/10.1016/S0039-6060(99)70234-5

18. Birkmeyer J.D., Warshaw A.L., Finlayson S.R.G., Grove M.R., Tosteson A.N.A. Relationship between hospital volume and late survival aft er pancreaticoduodenectomy. Surgery. 1999; 126 (2): 178–183. https://doi.org/10.1016/S0039-6060(99)70152-2

19. Scheiman J., Hwang J., Moayyedi P. American gastroenterological association technical review on the diagnosis and management of asymptomatic neoplastic pancreatic cysts. Gastroenterology. 2015; 148 (4): 824–848. https://doi.org/10.1053/j.gastro.2015.01.014

20. Braga M., Capretti G., Pecorelli N., Balzano G., Doglioni C., Ariotti R., Di Carlo V. A prognostic score to predict major complications after pancreaticoduodenectomy. Ann. Surg. 2011; 254 (5): 702–708. https://doi.org/10.1097/sla.0b013e31823598fb

21. PancreasGroup.org Collaborative. Pancreatic surgery outcomes: multicentre prospective snapshot study in 67 countries. Br. J. Surg. 2024; 111 (1): 330. https://doi.org/10.1093/bjs/znad330

22. Sánchez-Velázquez P., Muller X., Malleo G., Park J.-S., Hwang H.-K., Napoli N., Javed A.A., Inoue Y., Beghdadi N., Kalisvaart M., Vigia E., Walsh C.D., Lovasik B., Busquets J., Scandavini ., Robin F., Yoshitomi H., Mackay T.M., Busch O.R., Hartog H., Heinrich S., Gleisner, A., Perinel J., Passeri M., Lluis N., Raptis D.A., Tschuor C., Oberkofler C.E., DeOliveira M.L., Petrowsky H., Martinie J., Asbun H., Adham M., Schulick R., Lang H., Koerkamp B.G., Besselink M.G., Han H.-S., Miyazaki M., Ferrone C.R., Fernández-del Castillo C., Lillemoe K.D., Sulpice L., Boudjema K., Del Chiaro M., Fabregat J., Kooby D.A., Allen P., Lavu H., Yeo C.J., Barroso E., Roberts K., Muiesan P., Sauvanet A., Saiura A., Wolfgang C.L., Cameron J.L., Boggi U., Yoon D.-S., Bassi C., Puhan M.A., Clavien P.-A. Benchmarks in pancreatic surgery: a novel tool for unbiased outcome comparisons. Ann. Surg. 2019; 270 (2): 211–218. https://doi.org/10.1097/SLA.0000000000003223.

23. Javaheri H., Ghamarnejad O., Bade R., Lukowicz P., Karolus J., Stavrou G.A. Beyond the visible: preliminary evaluation of the first wearable augmented reality assistance system for pancreatic surgery. Int. J. Comput. Assist. Radiol. Surg. 2024; 20 (1): 117–129. https://doi.org/10.1007/s11548-024-03131-0

24. Tang R., Yang W., Hou Y., Yu L., Wu G., Tong X., Yan J., Lu Q. Augmented Reality-Assisted Pancreaticoduodenectomy with Superior Mesenteric Vein Resection and Reconstruction. Gastroenterol. Res. Pract. 202; 17: 7. https://doi.org/10.1155/2021/9621323

25. Marzano E., Piardi T., Soler L., Diana M., Mutter D., Marescaux J., Pessaux P. Augmented reality-guided artery-first pancreatico-duodenectomy. J. Gastrointest. Surg. 2013; 17 (11): 1980–1983. https://doi.org/10.1007/s11605-013-2307-1

26. Onda S., Okamoto T., Kanehira M., Suzuki F., Ito R., Fujioka S., Suzuki N., Hattori A., Yanaga K. Identification of inferior pancreaticoduodenal artery during pancreaticoduodenectomy using augmented reality-based navigation system. J. Hepatobiliary. Pancreat. Sci. 2014; 21(4): 281–287. https://doi.org/10.1002/jhbp.25