Development and evaluation of a haptic-visual learning system for surgical interventions
Project description
Motivation
Performing complex operations on bony tissue while avoiding injuries to risk structures such as nerves or vessels is one of the most important activities of surgeons. In order to perform such operations safely and without errors, extensive theoretical and practical (sometimes extra-occupational) training and further education as well as many years of experience are necessary.
Goals and procedure
In this project, a haptic-visual training system for surgical interventions on complex bone structures using clinical volume data (CT, MRT) will be realized, which is designed as a so-called "serious game" with immersive didactics. It is a synergistic supplement to existing training and education possibilities on animal models and fills the gap between "training on patients" and realistic virtual interaction by means of a haptic and visual learning experience.
Innovations and perspectives
The continuous further training of medical staff in the field of minimally invasive surgery is thus not limited to a few specialised centres, but can also be extended to smaller clinics in rural areas. Such a broadening of practice-oriented education and training in surgical specialties can make an important contribution to counteracting the lack of specialists in the area.
Realization of minimally invasive hand surgery
Subproject of the OTH Regensburg
Promotion
BMBF funding measure within the funding priority "ICT 2020 - Research for Innovations", funding code 16SV7560
Period and volume
June 2016 to May 2019
Overall project: approx. 1.26 million €, sub-project of the OTH Regensburg: approx. 357 T€
Cooperation partners
- szenaris GmbH, Bremen
- seeFront GmbH, Hamburg
- Fraunhofer-Institut für Integrierte Schaltungen (IIS), Erlangen
- Universitätsklinikum Leipzig AöR, Leipzig
- Universitätsklinikum Regensburg, Regensburg
- Ostbayerische Technische Hochschule Regensburg, Regensburg
Team OTH Regensburg
- Christoph Palm (Projektleiter, Regensburg Medical Image Computing)
- Johannes Maier (Regensburg Medical Image Computing)
- Sonja Haug (Institut für Sozialforschung und Technikfolgenabschätzung)
- Karsten Weber (Institut für Sozialforschung und Technikfolgenabschätzung)
- Ulrike Scorna (Institut für Sozialforschung und Technikfolgenabschätzung)
- Florian Olbrich (Sensorik Applikationszentrum)
Publications
Projekt HaptiVisT (Prof. Palm)
2020 |
|||
| Johannes Maier | Entwicklung eines Haptisch und Visuell unterstützten Trainingssystems (HaptiVisT) für komplexe Knochenbohrungen in der minimalinvasiven Handchirurgie | Doctoral thesis, 2020 | BibTeX 978-3-8440-7547-2, |
| Johannes Maier, Maximilian Weiherer, Michaela Huber, Christoph Palm | Optically tracked and 3D printed haptic phantom hand for surgical training system | Quantitative Imaging in Medicine and Surgery, 10(02), pp. 340-455, 2020 | BibTeX DOI |
2019 |
|||
| Johannes Maier, Jerome Perret, Martina Simon, Stephanie Schmitt-Rüth, Thomas Wittenberg, Christoph Palm | Force-feedback assisted and virtual fixtures based K-wire drilling simulation | Computers in Biology and Medicine, 114(103473), pp. 1-10, 2019 | BibTeX DOI |
| Johannes Maier, Maximilian Weiherer, Michaela Huber, Christoph Palm | Imitating human soft tissue on basis of a dual-material 3D print using a support-filled metamaterial to provide bimanual haptic for a hand surgery training system | Quantitative Imaging in Medicine and Surgery, 9(1), pp. 30-42, 2019 | BibTeX DOI |
2018 |
|||
| Thomas Eixelberger, Thomas Wittenberg, Jerome Perret, Uwe Katzky, Martina Simon, Stephanie Schmitt-Rüth, Mathias Hofer, M. Sorge, R. Jacob, Felix B. Engel, A. Gostian, Christoph Palm, Daniela Franz | A haptic model for virtual petrosal bone milling | 17. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie (CURAC2018), Tagungsband, 2018, Leipzig, 13.-15. September, pp. 214-219, 2018 |
BibTeX |
| Daniela Franz, Maria Dreher, Martin Prinzen, Matthias Teßmann, Christoph Palm, Uwe Katzky, Jerome Perret, Mathias Hofer, Thomas Wittenberg | CT-basiertes virtuelles Fräsen am Felsenbein | Bildverarbeitung für die Medizin 2018; Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 11. bis 13. März 2018 in Erlangen, pp. 176-181, 2018 | BibTeX 978-3-662-56537-7, DOI |
| Johannes Maier, Michaela Huber, Uwe Katzky, Jerome Perret, Thomas Wittenberg, Christoph Palm | Force-Feedback-assisted Bone Drilling Simulation Based on CT Data | Bildverarbeitung für die Medizin 2018; Algorithmen - Systeme - Anwendungen; Proceedings des Workshops vom 11. bis 13. März 2018 in Erlangen, pp. 291-296, 2018 | BibTeX DOI |
2017 |
|||
| Johannes Maier, Sonja Haug, Michaela Huber, Uwe Katzky, Sabine Neumann, Jérôme Perret, Martin Prinzen, Karsten Weber, Thomas Wittenberg, Rebecca Wöhl, Ulrike Scorna, Christoph Palm | Development of a haptic and visual assisted training simulation concept for complex bone drilling in minimally invasive hand surgery | CARS Conference, 5.10.-7.10.2017, 2017 |
BibTeX |
2016 |
|||
| Daniela Franz, Uwe Katzky, S. Neumann, Jerome Perret, Mathias Hofer, Michaela Huber, Stephanie Schmitt-Rüth, Sonja Haug, Karsten Weber, Martin Prinzen, Christoph Palm, Thomas Wittenberg | Haptisches Lernen für Cochlea Implantationen | 15. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie (CURAC2016), Tagungsband, 2016, Bern, 29.09. - 01.10., pp. 21-26, 2016 |
BibTeX |