DeepMIC - Deep learning based endoscope tracking
The DeepMIC project is creating a new approach for an intelligent, collaborative assistance system for camera guidance during minimally invasive surgical procedures. The new assistance system is to be characterized by an adaptivity in use that has not yet been achieved to any degree, intuitive operability and the ability to cooperate actively (semi-) automatically with the surgeon and thus be capable of the best possible camera guidance virtually on its own.
The innovative approach consists of a continuous evaluation and classification of the information of the endoscopic camera image by methods of artificial intelligence (here especially Deep Learning) in combination with natural speech recognition. Combined with knowledge from the surgical workflow, the system should allow interaction with the surgeon that is similar to a human assistant and can thus react directly to the current requirements of the procedure.