华南理工大学学报(自然科学版) ›› 2025, Vol. 53 ›› Issue (9): 76-85.doi: 10.12141/j.issn.1000-565X.250025

• 机械工程 • 上一篇    下一篇

骨科虚拟手术视觉与力觉融合交互算法研究

王清辉1,2 方道鑫1 池梓鹏1 倪建龙1 谢海龙3 李静蓉1 李春海4   

  1. 1. 华南理工大学机械与汽车工程学院,广东 广州 510640;

    2. 人工智能与数字经济广东省实验室(广州),广东 广州 510330;

    3. 华南理工大学设计学院,广东 广州 510640;

    4. 中山大学孙逸仙纪念医院骨外科,广东 广州 510120

  • 出版日期:2025-09-25 发布日期:2025-03-21

Visual and Haptic Interactive Algorithm for Orthopedic Virtual Surgery

WANG Qinghui1,2 FANG Daoxin1 CHI Zipeng1 NI Jianlong1 XIE Hailong3 LI Jingrong1 LI Chunhai4   

  1. 1. School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou 510640, Guangdong, China;

    2. Guangdong Laboratory of Artificial Intelligence and Digital Economy (Guangzhou), Guangzhou 510330, Guangdong, China;

    3. School of Design, South China University of Technology, Guangzhou 510640, Guangdong, China;

    4. Department of Orthopedic Surgery, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou 510120, Guangdong, China

  • Online:2025-09-25 Published:2025-03-21

摘要:

实时的视觉和精细的力觉融合交互算法是实现虚拟手术训练中精准“手感”的关键。以骨科手术中关键的骨铣削操作为例,首先采用Tri-dexel模型表示骨和医用铣刀,通过布尔运算和快速表面重建及渲染算法实现虚拟骨铣削操作过中的实时几何变形计算;接着,结合医用铣刀的几何参数,提出基于微元切削力的骨铣削力觉交互模型,利用骨与医用铣刀Tri-Dexel模型之间布尔运算的结果,快速实现对瞬时未变形切屑厚度的精确求解;同时,通过槽切实验完成对切削力系数的辨识,并对该力觉模型进行验证分析,实现虚拟骨铣削操作过程中的力觉渲染;最后,基于上述算法搭建骨科虚拟手术训练系统,开展实验对视觉与力觉融合交互算法进行测试与评估。结果表明:力觉模型的预测结果与实验测量结果吻合较好,力平均相对误差在7%以下,该算法能够同时满足30 Hz的视觉刷新频率以及1 kHz的力觉刷新频率要求,所搭建的骨科虚拟手术训练系统能够为用户提供高沉浸的虚拟骨铣削操作训练,可有效提高用户的手眼协调能力。

关键词: 虚拟手术, 力反馈, 力觉交互, Tri-dexel, 切削力

Abstract:

Real-time visual and precise haptic interaction algorithms are critical for achieving accurate "tactile sensation" in virtual surgical training. Taking the key bone milling operation in orthopedic surgery as an example,the Tri-dexel model is first employed to represent the bone and the surgical milling tool. Real-time geometric deformation during the virtual bone milling is achieved through boolean operations and rapid surface reconstruction algorithms. Next, by integrating the geometric parameters of the surgical milling tool, a haptic interaction model based on the micro-element cutting force is proposed. This model utilizes the boolean operation results between the bone and surgical millimg tool to quickly achieve accurate calculation of the instantaneous undeformed chip thickness. The cutting force coefficients are identified and the haptic interaction model is validated through milling experiments to achieve haptic rendering. Finally, based on the aforementioned algorithms, an orthopedic virtual surgical training system is developed, and evaluation experiments are conducted. The results show that the predicted forces align with experimental measurements, with an average force error of less than 7%. The visual and haptic interactive algorithm satisfies a visual refresh rate of 30 Hz and a haptic refresh rate of 1 kHz. The developed orthopedic virtual surgical training system provides users with a highly immersive virtual bone milling training experience that can effectively improve users' hand-eye coordination.

Key words: virtual surgery, force feedback, haptic interaction; Tri-dexel, cutting force