An Interactive Real-Time Cutting Technique for 3D Models in Mixed Reality

• Published in: Technologies (Basel) Vol. 8; no. 2; p. 23
• Main Authors: Caligiana, Paolo, Liverani, Alfredo, Ceruti, Alessandro, Santi, Gian Maria, Donnici, Giampiero, Osti, Francesco
• Format: Journal Article
• Language: English
• Published: MDPI AG 01-06-2020
• Subjects: cutting algorithm; leap motion; Mixed Reality; unity
• ISSN: 2227-7080; 2227-7080
• DOI: 10.3390/technologies8020023

This work describes a Mixed Reality application useful to modify and cut virtual objects. A digital simulation of surgical operations is presented. Following this approach, surgeons can test all the designed solutions of the preoperative stage in a Mixed Reality environment. High precision in surgery applications can be achieved thanks to the new methodology. The presented solution is hands free and does not need the use of a mouse or computer’s keyboard: it is based on HoloLens, Leap Motion device and Unity. A new cutting algorithm has been developed in order to handle multiple objects and speed up the cut with complex meshes and preserve geometry quality. A case study presents the cut of several bones in order to simulate surgeon’s operations. A reduction in cut time compared to the original method is noticed, together with a high flexibility of the tool and a good fidelity of the geometry. Moreover, all the object fragments generated from the algorithm are available for manipulation and new cuts.