Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 3/2024

09.12.2023 | Original Article

Online advance respiration prediction model for percutaneous puncture robotics

verfasst von: Yanping Lin, Jin Guo, Xu Yang, Wangjie Xu, Zhaojun Li

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 3/2024

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Surgical robots have significant research value and clinical significance in the field of percutaneous punctures. There have been numerous studies on ultrasound-guided percutaneous surgical robots; however, addressing the respiratory compensation problem of deep punctures remains a significant obstacle. Herein we propose a robotic system for percutaneous puncture with respiratory compensation.

Methods

We proposed an online advance respiratory prediction model based on Bidirectional Gate Recurrent Unit (Bi-GRU) for the respiratory prediction requirements of surgical robot systems. By analyzing the main factors governing the accuracy of the respiratory motion prediction models, various parameters of the online advance prediction model were optimized. Subsequently, we integrated and developed ultrasound-guided percutaneous puncture robot software and a hardware platform to implement respiratory compensation, thus verifying the effectiveness and reliability of various key technologies in the system.

Results

The proposed respiratory prediction model has a significantly reduced update time, with an average root mean square error (RMSE) of less than 0.4 mm. This represents a reduction of ~ 20% compared to the online training long short-term memory(LSTM). By conducting puncture experiments based on a respiratory phantom, the average puncture error was 2.71 ± 0.65 mm and the average single-round puncture time was 65.00 ± 6.67 s.

Conclusion

Herein we proposed and optimized an online training respiratory prediction network model based on Bi-GRU. The stability and reliability of this system are verified by conducting puncture experiments on a respiratory phantom.
Literatur
1.
Zurück zum Zitat Hanley J, Debois MM, Mah D, Mageras GS, Raben A, Rosenzweig K, Mychalczak B, Schwartz LH, Gloeggler PJ, Lutz W, Ling CC, Leibel SA, Fuks Z, Kutcher GJ (1999) Deep inspiration breath-hold technique for lung tumors: the potential value of target immobilization and reduced lung density in dose escalation. Int Radiat Oncol Biol Phys 45(3):603–611CrossRef Hanley J, Debois MM, Mah D, Mageras GS, Raben A, Rosenzweig K, Mychalczak B, Schwartz LH, Gloeggler PJ, Lutz W, Ling CC, Leibel SA, Fuks Z, Kutcher GJ (1999) Deep inspiration breath-hold technique for lung tumors: the potential value of target immobilization and reduced lung density in dose escalation. Int Radiat Oncol Biol Phys 45(3):603–611CrossRef
2.
Zurück zum Zitat Zhou FG, Wang HX, Yu XG, Yan D (2007) Respiratory motion analysis based on image tracking. Chin J Biomed Eng 26(5):652–657 Zhou FG, Wang HX, Yu XG, Yan D (2007) Respiratory motion analysis based on image tracking. Chin J Biomed Eng 26(5):652–657
3.
Zurück zum Zitat Zhou Y, Thiruvalluvan K, Krzeminski L, Moore WH, Xu ZG, Liang ZR (2013) CT-guided robotic needle biopsy of lung nodules with respiratory motion-experimental system and preliminary test. Int J Med Robot 9(3):317–330CrossRefPubMed Zhou Y, Thiruvalluvan K, Krzeminski L, Moore WH, Xu ZG, Liang ZR (2013) CT-guided robotic needle biopsy of lung nodules with respiratory motion-experimental system and preliminary test. Int J Med Robot 9(3):317–330CrossRefPubMed
4.
Zurück zum Zitat Karar ME (2018) A simulation study of adaptive force controller for medical robotic liver ultrasound guidance. Arab J Sci Eng 43:4229–4238ADSCrossRef Karar ME (2018) A simulation study of adaptive force controller for medical robotic liver ultrasound guidance. Arab J Sci Eng 43:4229–4238ADSCrossRef
5.
Zurück zum Zitat Kim YJ, Seo JH, Kim HR, Kim KG (2017) Impedance and admittance control for respiratory-motion compensation during robotic needle insertion-a preliminary test. Int J Med Robot 13(4):493–500CrossRef Kim YJ, Seo JH, Kim HR, Kim KG (2017) Impedance and admittance control for respiratory-motion compensation during robotic needle insertion-a preliminary test. Int J Med Robot 13(4):493–500CrossRef
6.
Zurück zum Zitat Seitz PK, Baumann B, Johnen W, Lissek C, Seidel J, Bendl R (2020) Development of a robot-assisted ultrasound-guided radiation therapy (USgRT). Int J Comput Assist Radiol Surg 15(3):491–501CrossRefPubMed Seitz PK, Baumann B, Johnen W, Lissek C, Seidel J, Bendl R (2020) Development of a robot-assisted ultrasound-guided radiation therapy (USgRT). Int J Comput Assist Radiol Surg 15(3):491–501CrossRefPubMed
7.
Zurück zum Zitat Ramrath L, Schlaefer A, Ernst F, Dieterich S, Schweikard A (2007). Prediction of respiratory motion with a multi-frequency based Extended Kalman Filter. In: Proceedings of the 21st International Conference and Exhibition on Computer Assisted Radiology and Surgery (CARS’07), 21: 56–58. Ramrath L, Schlaefer A, Ernst F, Dieterich S, Schweikard A (2007). Prediction of respiratory motion with a multi-frequency based Extended Kalman Filter. In: Proceedings of the 21st International Conference and Exhibition on Computer Assisted Radiology and Surgery (CARS’07), 21: 56–58.
8.
Zurück zum Zitat Hong S-M, Bukhari W (2014) Real-time prediction of respiratory motion using a cascade structure of an extended Kalman filter and support vector regression. Phys Med Biol 59(13):3555–3573CrossRefPubMed Hong S-M, Bukhari W (2014) Real-time prediction of respiratory motion using a cascade structure of an extended Kalman filter and support vector regression. Phys Med Biol 59(13):3555–3573CrossRefPubMed
9.
Zurück zum Zitat Dürichen R, Blanck O, Dieterich S, Ernst F, Schweikard A (2012) Evaluation of a wavelet-based least mean square algorithm for prediction of respiratory movements. The SRS/SBRT Scientific Meeting 2012:S7–S8 Dürichen R, Blanck O, Dieterich S, Ernst F, Schweikard A (2012) Evaluation of a wavelet-based least mean square algorithm for prediction of respiratory movements. The SRS/SBRT Scientific Meeting 2012:S7–S8
10.
Zurück zum Zitat Zhang GP (2003) Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50:159–175CrossRef Zhang GP (2003) Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50:159–175CrossRef
11.
Zurück zum Zitat Wu H, Sharp GC, Salzberg B, Kaeli D, Shirato H, Jiang SB (2004) A finite state model for respiratory motion analysis in image guided radiation therapy. Phys Med Biol 49(23):5357–5372CrossRefPubMed Wu H, Sharp GC, Salzberg B, Kaeli D, Shirato H, Jiang SB (2004) A finite state model for respiratory motion analysis in image guided radiation therapy. Phys Med Biol 49(23):5357–5372CrossRefPubMed
12.
Zurück zum Zitat Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput 31(7):1235–1270MathSciNetCrossRefPubMed Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput 31(7):1235–1270MathSciNetCrossRefPubMed
13.
Zurück zum Zitat Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45(11):2673–2681ADSCrossRef Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45(11):2673–2681ADSCrossRef
14.
Zurück zum Zitat Chung J, Gulcehre C, Cho K, Bengio Y (2015) Gated feedback recurrent neural networks. In: Proceedings of the 32nd International Conference on Machine Learning. PMLR, pp 2067–2075 Chung J, Gulcehre C, Cho K, Bengio Y (2015) Gated feedback recurrent neural networks. In: Proceedings of the 32nd International Conference on Machine Learning. PMLR, pp 2067–2075
15.
Zurück zum Zitat Chen L, Bai L, Li GJ, Quan H, Bai S (2021) Research on real-time motion monitoring accuracy of optical surface imaging system. Chinese J Med Phys 38(9):1053–1056 Chen L, Bai L, Li GJ, Quan H, Bai S (2021) Research on real-time motion monitoring accuracy of optical surface imaging system. Chinese J Med Phys 38(9):1053–1056
16.
Zurück zum Zitat Dürichen R, Wissel T, Ernst F, Schweikard A (2013) Respiratory motion compensation with relevance vector machines. Med Image Comput Comput Assist Interv 16(2):108–115PubMed Dürichen R, Wissel T, Ernst F, Schweikard A (2013) Respiratory motion compensation with relevance vector machines. Med Image Comput Comput Assist Interv 16(2):108–115PubMed
17.
Zurück zum Zitat Lombardo E, Rabe M, Xiong Y, Nierer L, Cusumano D, Placidi L, Boldrini L, Corradini S, Niyazi M, Belka C, Riboldi M, Kurz C, Landry G (2022) Offline and online LSTM networks for respiratory motion prediction in MR-guided radiotherapy. Phys Med Biol 67(9):095006CrossRef Lombardo E, Rabe M, Xiong Y, Nierer L, Cusumano D, Placidi L, Boldrini L, Corradini S, Niyazi M, Belka C, Riboldi M, Kurz C, Landry G (2022) Offline and online LSTM networks for respiratory motion prediction in MR-guided radiotherapy. Phys Med Biol 67(9):095006CrossRef
18.
Zurück zum Zitat Greff K, Srivastava RK, Koutník J, Steunebrink BR, Schmidhuber J (2016) LSTM: a search space odyssey. IEEE Trans Neural Netw Learn Syst 28(10):2222–2232MathSciNetCrossRefPubMed Greff K, Srivastava RK, Koutník J, Steunebrink BR, Schmidhuber J (2016) LSTM: a search space odyssey. IEEE Trans Neural Netw Learn Syst 28(10):2222–2232MathSciNetCrossRefPubMed
19.
Zurück zum Zitat Lin H, Shi CY, Wang B, Chan MF, Tang XL, Ji W (2019) Towards real-time respiratory motion prediction based on long short-term memory neural networks. Phys Med Biol 64(8):1361–1372CrossRef Lin H, Shi CY, Wang B, Chan MF, Tang XL, Ji W (2019) Towards real-time respiratory motion prediction based on long short-term memory neural networks. Phys Med Biol 64(8):1361–1372CrossRef
20.
Zurück zum Zitat Lin YP, Chen SH, Xu WJ, Zhu XX, Cao QX (2023) Robotic system for accurate percutaneous puncture guided by 3D–2D ultrasound. Int J Comput Assist Radiol Surg 18(2):217–225CrossRefPubMed Lin YP, Chen SH, Xu WJ, Zhu XX, Cao QX (2023) Robotic system for accurate percutaneous puncture guided by 3D–2D ultrasound. Int J Comput Assist Radiol Surg 18(2):217–225CrossRefPubMed
21.
Zurück zum Zitat Chen SH, Wang F, Lin YP, Shi QS, Wang YL (2021) Ultrasound-guided needle insertion robotic system for percutaneous puncture. Int J Comput Assist Radiol Surg 16(3):475–484CrossRefPubMed Chen SH, Wang F, Lin YP, Shi QS, Wang YL (2021) Ultrasound-guided needle insertion robotic system for percutaneous puncture. Int J Comput Assist Radiol Surg 16(3):475–484CrossRefPubMed
22.
Zurück zum Zitat Wang G, Li Z, Li G et al (2021) Real-time liver tracking algorithm based on LSTM and SVR networks for use in surface-guided radiation therapy. Radiat Oncol 16(1):1–12MathSciNetCrossRef Wang G, Li Z, Li G et al (2021) Real-time liver tracking algorithm based on LSTM and SVR networks for use in surface-guided radiation therapy. Radiat Oncol 16(1):1–12MathSciNetCrossRef
23.
Zurück zum Zitat Wang R, Liang X, Zhu X et al (2018) A feasibility of respiration prediction based on deep Bi-LSTM for real-time tumor tracking. IEEE Access 6:51262–51268CrossRef Wang R, Liang X, Zhu X et al (2018) A feasibility of respiration prediction based on deep Bi-LSTM for real-time tumor tracking. IEEE Access 6:51262–51268CrossRef
Metadaten
Titel
Online advance respiration prediction model for percutaneous puncture robotics
verfasst von
Yanping Lin
Jin Guo
Xu Yang
Wangjie Xu
Zhaojun Li
Publikationsdatum
09.12.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 3/2024
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-03041-7

Weitere Artikel der Ausgabe 3/2024

International Journal of Computer Assisted Radiology and Surgery 3/2024 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.