Video Object Detection Based on Correlation Feature and Convolutional Neural Network

doi:10.3969/j.issn.1000-565X.2018.12.004

Journal of South China University of Technology (Natural Science Edition)

• Computer Science & Technology • Previous Articles Next Articles

Video Object Detection Based on Correlation Feature and Convolutional Neural Network

LIU Yujie¹CAO Xianzhi¹ LI Zongmin¹ LI Hua^2,3

1． College of Computer ＆ Communication Engineering，China University of Petroleum，Qingdao 266580，Shandong，China; 2． Institute of Computing Technology，Chinese Academy of Sciences，Beijing 100190，China; 3． University of Chinese Academy of Sciences，Beijing 100190，China

Received:2018-07-15 Online:2018-12-25 Published:2018-11-01
Contact: 刘玉杰(1971-)，男，博士，副教授，主要从事计算机图形图像处理、多媒体数据库、多媒体数据压缩研究． E-mail:liuyujie@upc.edu.cn
About author:刘玉杰(1971-)，男，博士，副教授，主要从事计算机图形图像处理、多媒体数据库、多媒体数据压缩研究．
Supported by:
Supportal by the National Natural Science Foundation of China(61379106) and the Natural Science Foundation of Shandong Province，China(ZR2015FM011，ZR2013FM036)

Abstract

Abstract: The problem of mutual restriction between speed and precision caused by using image detection algorithm in the field of video object detection，a video detection method based on correlation features and convolutional neu- ral network is proposed in order to make full use of the target’s motion between frames． Our methods are demon- strated as follows: firstly，an image detection algorithm is used to extract features from the current video frame; sec- ondly，the correlation features between the frames is employed to predict the feature maps of the current frame and finally，the target motion information from the associated features is used to predict the final result． The method proposed in this paper finally experimented on the ImageNet dataset，which is proved better than the current method since the precision is enhanced and a faster speed is maintained．

Key words: video object detection, convolutional neural network, correlation feature

LIU Yujie CAO Xianzhi LI Zongmin LI Hua. Video Object Detection Based on Correlation Feature and Convolutional Neural Network[J]. Journal of South China University of Technology (Natural Science Edition), doi: 10.3969/j.issn.1000-565X.2018.12.004.

[1]	MA Xiaoliang, AN Lingling, DENG Congjian, et al. Translation Optimization Technology of Automatic Speech Recognition Based on Industry-Specific Vocabulary [J]. Journal of South China University of Technology(Natural Science Edition), 2023, 51(8): 118-125.
[2]	ZHU Zhengyu, LUO Chao, HE Qianhua, et al. Multi-View Lip Motion and Voice Consistency Judgment Based on Lip Reconstruction and Three-Dimensional Coupled CNN [J]. Journal of South China University of Technology(Natural Science Edition), 2023, 51(5): 70-77.
[3]	YE Feng, CHEN Biao, LAI Yizong. Contrastive Knowledge Distillation Method Based on Feature Space Embedding [J]. Journal of South China University of Technology(Natural Science Edition), 2023, 51(5): 13-23.
[4]	QIU Zhibin, LU Zuwen, WANG Haixiang, et al. Recognition of Bird Sounds Related to Power Grid Faults Based on Mel Spectrogram and Convolutional Neural Network [J]. Journal of South China University of Technology(Natural Science Edition), 2022, 50(2): 129-136.
[5]	ZHANG Xiangzhu, ZHANG Lijia, SONG Yifan, et al. Obstacle Avoidance Algorithm for Unmanned Aerial Vehicle Vision Based on Deep Learning [J]. Journal of South China University of Technology (Natural Science Edition), 2022, 50(1): 101-108, 131.
[6]	HUANG Min QI Haitao JIANG Chunlin. Coupled Collaborative Filtering Model Based on Attention Mechanism [J]. Journal of South China University of Technology(Natural Science Edition), 2021, 49(7): 59-65.
[7]	Qi LIU Bin Yu. Pavement Crack Recognition Algorithm Based on Transposed CNN [J]. Journal of South China University of Technology(Natural Science Edition), 2021, 49(12): 124-132.
[8]	LI Bo RAO Haobo. Salient Object Detection Based on Feature Enhancement in Complex Scene [J]. Journal of South China University of Technology (Natural Science Edition), 2021, 49(11): 135-144.
[9]	DU Qiliang, HUANG Liguang, TIAN Lianfang, et al. Recognition of Passengers＇Abnormal Behavior on Escalator Based on Video Monitoring [J]. Journal of South China University of Technology (Natural Science Edition), 2020, 48(8): 10-21.
[10]	CHEN Shanxiong, HAN Xu, LIN Xiaoyu, et al. MSER and CNN-Based Method for Character Detection in Ancient Yi Books [J]. Journal of South China University of Technology (Natural Science Edition), 2020, 48(6): 123-133.
[11]	FAN Zizhu, WANG Song, ZHANG Hong, et al. W-Net-Based Segmentation for Ｒemote Sensing Satellite Image of High Resolution [J]. Journal of South China University of Technology (Natural Science Edition), 2020, 48(12): 114-124.
[12]	LIU Jianguo, FENG Yunjian, JI Guo, et al. Improved Stereo Matching Algorithm Based on PSMNet [J]. Journal of South China University of Technology (Natural Science Edition), 2020, 48(1): 60-69,83.
[13]	WANG Weining LI Lemin HUANG Jiexiong LUO Jiebo XU Xiangmin. A Multi-level Deep Convolutional Neural Network for Image Emotion Classification [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(6): 39-50.
[14]	TIAN Lianfang WU Qichao DU Qiliang HUANG Liguang LI Miao ZHANG Daming. Recognition of Passengers＇Abnormal Behavior on the Escalator Based on Human Skeleton Sequence [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(4): 10-19.
[15]	XIAO Huanhou SHI Jinglun. Video Captioning Based on C3D and visual elements [J]. Journal of South China University of Technology (Natural Science Edition), 2018, 46(8): 88-95.

Video Object Detection Based on Correlation Feature and Convolutional Neural Network

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments