MIDL 2021

International Conference on
Medical Imaging with Deep Learning
5. bis 7. Juli 2021

Direct Visuo-Haptic 4D Volume Rendering Using Respiratory Motion Models

TitleDirect Visuo-Haptic 4D Volume Rendering Using Respiratory Motion Models
Publication TypeJournal Article
Year of Publication2015
AuthorsFortmeier D., Wilms M., Mastmeyer A., Handels H.
JournalIEEE Transactions on Haptics
Pages371 - 383
Date Published10/2015
Publication Languageeng

This article presents methods for direct visuo-haptic 4D volume rendering of virtual patient models under respiratory motion. Breathing models are computed based on patient-specific 4D CT image data sequences. Virtual patient models are visualized in real-time by ray casting based rendering of a reference CT image warped by a time-variant displacement field, which is computed using the motion models at run-time. Furthermore, haptic interaction with the animated virtual patient models is provided by using the displacements computed at high rendering rates to translate the position of the haptic device into the space of the reference CT image. This concept is applied to virtual palpation and the haptic simulation of insertion of a virtual bendable needle. To this aim, different motion models that are applicable in real-time are presented and the methods are integrated into a needle puncture training simulation framework, which can be used for simulated biopsy or vessel puncture in the liver. To confirm real-time applicability, a performance analysis of the resulting framework is given. It is shown that the presented methods achieve mean update rates around 2000 Hz for haptic simulation and interactive frame rates for volume rendering and thus are well suited for visuo-haptic rendering of virtual patients under respiratory motion.

PubMed Link


Short TitleIEEE Trans. Haptics
2015TOH_Fortmeier.pdf7.05 MB
Created at April 12, 2016 - 2:36pm.


Program of Study

Study Medical Informatics
at the University of Lübeck

read more ...


Susanne Petersen

Tel+49 451 3101 5601
Fax+49 451 3101 5604

Ratzeburger Allee 160
23538 Lübeck