机械工程

基于多目近红外视觉的多目标实时跟踪方法

  • 陈忠 ,
  • 王傲辰 ,
  • 高心怡 ,
  • 何利辉 ,
  • 张宪民
展开
  • 华南理工大学 机械与汽车工程学院,广东 广州 510640
陈忠(1968—),男,博士,教授,主要从事柔顺机构动力、机器视觉技术及其应用、精密测量和故障诊断研究。E-mail: mezhchen@scut.edu.cn

收稿日期: 2024-08-27

  网络出版日期: 2025-02-20

基金资助

广东省自然科学基金项目(2022A1515011263)

Multi-Object Real-Time Tracking Method Based on Multi-View Near-Infrared Vision

  • CHEN Zhong ,
  • WANG Aochen ,
  • GAO Xinyi ,
  • HE Lihui ,
  • ZHANG Xianmin
Expand
  • School of Mechanical and Automotive Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China
陈忠(1968—),男,博士,教授,主要从事柔顺机构动力、机器视觉技术及其应用、精密测量和故障诊断研究。E-mail: mezhchen@scut.edu.cn

Received date: 2024-08-27

  Online published: 2025-02-20

Supported by

the Natural Science Foundation of Guangdong Province(2022A1515011263)

摘要

近红外光学跟踪系统能够根据附着于被跟踪物体上的反光标记球实时还原被跟踪物体的运动,目前已被广泛应用于多种领域。该研究提出了一种对目标丢失具有一定鲁棒性的多目近红外目标实时跟踪方法。首先,针对反光标记球在近红外相机中的成像特性,利用灰度质心法提取各个反光标记球的几何中心,然后在各单目相机中使用SORT算法作为多目标跟踪方法对各个标记点进行帧间匹配,并根据对极几何原理,结合带权二分图匹配方法确定反光标记球在各个相机中像点的匹配关系,依据三角测量方法实时计算各个受跟踪反光标记球的三维空间坐标;其次,根据运动过程中各反光标记球之间的空间位置关系对反光标记球进行分组,识别属于同一物体的反光标记球,并根据同组反光标记球间的欧氏距离建立被跟踪物体与反光标记球的外观特征向量,以此作为物体丢失重现的匹配依据,而完全丢失后再重现的被跟踪物体利用外观特征向量的余弦距离进行重匹配;最后,对所提方法进行实验验证。实验结果表明:所提方法在不小于60 f/s的帧率下的跟踪精度约可达0.5 mm;另外,其可以对丢失的重现物体以及反光标记球进行正确的重匹配。

本文引用格式

陈忠 , 王傲辰 , 高心怡 , 何利辉 , 张宪民 . 基于多目近红外视觉的多目标实时跟踪方法[J]. 华南理工大学学报(自然科学版), 2025 , 53(7) : 31 -38 . DOI: 10.12141/j.issn.1000-565X.240427

Abstract

Near-infrared optical tracking systems can restore the movement of tracked objects in real time based on the markers attached to the tracked objects. This technology has now been widely adopted across numerous fields. This paper proposed a real-time tracking method for muli-objects that is robust to target loss. First, based on the imaging characteristics of reflective marker balls in near-infrared cameras, the geometric center of each marker was extracted using the grayscale centroid method. Then, the SORT algorithm was used as a multi-objetcs tracking method in each monocular camera to match each marker point between frames. The matching relationship of the image points of the markers in each camera was determined based on the principle of epipolar geometry combined with the weighted bipartite graph matching method, and the three-dimensional spatial coordinates of each tracked marker were calculated in real time based on the triangulation method. Next, the markers were grouped based on their spatial relationships during motion to identify markers belonging to the same object. Spatial feature vectors were established for tracked objects using the Euclidean distances between markers within the same group, serving as matching references for reappearing lost objects. When a fully lost object reproduced, re-matching is performed using cosine distance of these feature vectors. Finally, the proposed algorithm was experimentally verified. The experiment shows that the tracking accuracy of the proposed algorithm can reach about 0.5 mm at a speed of not less than 60 f/s. In addition, the lost reproduced objects and markers can be correctly re-matched.

参考文献

[1] LOWE D G .Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision200460:91-110.
[2] BAY H,ESS A, TUYTELAARS T,et al .Speeded-up robust features (SURF)[J].Computer Vision and Image Understanding2008110(3):346-359.
[3] ZHOU Z, WU B, DUAN J,et al .Optical surgical instrument tracking system based on the principle of stereo vision[J].Journal of Biomedical Optics201722(6):065005/1-15.
[4] LIN Q, YANG R, ZHANG Z,et al .Robust stereo-match algorithm for infrared markers in image-guided optical tracking system[J].IEEE Access20186:52421-52433.
[5] 王杰,仲重亮,朱伟东 .一种用于光学器械跟踪的近红外双目系统[J].红外与激光工程202251(6):161-170.
  WANG Jie, ZHONG Chongliang, ZHU Weidong .A near-infrared binocular system for optical instrument tracking[J].Infrared and Laser Engineering202251(6):161-170.
[6] ZHANG M, WU B, YE C,et al .Multiple instruments motion trajectory tracking in optical surgical navigation[J].Optics Express201927(11):15827-15845.
[7] ARISTIDOU A, LASENBY J .Real-time marker prediction and CoR estimation in optical motion capture[J].The Visual Computer201329:7-26.
[8] PIAZZA T, LUNDSTR?M J, KUNZ A,et al .Predicting missing markers in real-time optical motion capture[C]∥Proceedings of the Modelling the Physiological Human(3DPH2009).Zermatt:Springer,2009:125-136.
[9] BURKE M, LASENBY J .Estimating missing marker positions using low dimensional Kalman smoothing[J].Journal of Biomechanics201649(9):1854-1858.
[10] BEWLEY A, GE Z,OTT L,et al .Simple online and realtime tracking[C]∥Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP).Phoenix:IEEE,2016:3464-3468.
[11] R HARTLEY, ZISSERMAN A,Multiple view geo-metry in computer vision[M].2nd ed.Cambridge:Cambridge University Press,2003:239-242.
[12] ZHANG Z .A flexible new technique for camera calibration[J].IEEE Transactions on Pattern Analysis and Machine Intelligence200022(11):1330-1334.
[13] 李斌,谭光华,高春鸣 .红外摄像机组的一维标定物设计和标定[J].计算机应用201333(5):1423-1427,1449.
  LI Bin, TAN Guanghua, GAO Chunming .One-dimensional objects design and calibration in infrared camera group[J].Journal of Computer Applications201333(5):1423-1427,1449.
[14] KüMMERLE R, GRISETTI G, STRASDAT H,et al .g2o:a general framework for graph optimization[C]∥Proceedings of the 2011 IEEE International Conference on Robotics and Automation.Shanghai:IEEE,2011:3607-3613.
[15] CHADDA A, ZHU W, LEU M C,et al .Design implementation,and evaluation of optical low-cost motion capture system[C]∥Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference.Washington:ASME,2011:1451-1461.
[16] PINTARIC T, KAUFMANN H .Affordable infrared-optical pose-tracking for virtual and augmented reality[C]∥Proceedings of the Trends and Issues in Tracking for Virtual Environments Workshop,IEEE VR. Charlotte:IEEE,2007:44-51.
文章导航

/