Details

Autor(en) / Beteiligte

• Chen, Guowen
• Huang, Tianqi
• Fan, Zhencheng
• Zhang, Xinran
• Liao, Hongen

Titel

A naked eye 3D display and interaction system for medical education and training

Ist Teil von

• Journal of biomedical informatics, 2019-12, Vol.100, p.103319-103319, Article 103319

Ort / Verlag

United States: Elsevier Inc

Erscheinungsjahr

2019

Link zum Volltext

Quelle

Alma/SFX Local Collection

Beschreibungen/Notizen

• The system configuration of the naked eye 3D simulation system. [Display omitted] •A naked eye 3D display and interaction system for medical education and training, which comprises enhanced 3D rendering algorithm, elastic simulation and incremental interaction, is proposed.•The naked eye 3d display and interaction system can achieve binocular parallax and motion parallax, and provide a certain degree of immersion to achieve natural user interaction without wearing any glasses.•The octree based 3D rendering and interaction algorithm for naked eye 3D display achieves high rendering performance and smooth human-machine interaction. To provide natural simulated objects and intuitive user interaction in medical education and training, we propose a naked eye 3D display and interaction system. The current 3D rendering algorithms for naked eye 3D displays are not suitable for medical use, due to the requirements of displaying and interacting with high quality medical images and simulating soft tissues. Because the traditional 3D rendering procedure and vertex indexing in collision detection require substantial computing power when using a naked eye 3D display, the current method cannot achieve fluent displays and interactions. Thus, we develop a novel octree-based 3D rendering and interaction algorithm for high quality medical models to improve the rendering rate and obtain smooth human machine interactions when using the naked eye 3D display device. We also valuate the soft-body phantom simulation of the naked eye 3D display device by combining the traditional 3D rendering algorithm with the elastic 3D simulation to simulate deformable tissues. We integrate an incremental interaction method and a Kalman filter-based hand tracking method to achieve a larger user interaction range and robust hand tracking. We used the proposed system to perform human-computer interactions with rigid phantoms and soft-body phantoms. The experimental results showed that the proposed rendering algorithm for rigid phantoms could achieve higher rendering performance (50 FPS) than the traditional rendering algorithm (9.8 FPS). The user experiments showed that the 3D simulation system equipped with the enhanced rendering algorithm could achieve fluent interactions when using the naked eye 3D display, thus promoting education experiences and reducing task completion times.