Data Clustering of Ｒoad Transportation Information System Based on Attribute Dimension Partition and MapＲeduce

doi:10.3969/j.issn.1000-565X.2014.08.019

Journal of South China University of Technology (Natural Science Edition) ›› 2014, Vol. 42 ›› Issue (8): 122-128,135.doi: 10.3969/j.issn.1000-565X.2014.08.019

• Traffic & Transportation Engineering • Previous Articles Next Articles

Data Clustering of Ｒoad Transportation Information System Based on Attribute Dimension Partition and MapＲeduce

Zheng Xiao-feng Xu Jian-min Lu Kai

School of Civil Engineering and Transportation,South China University of Technology,Guangzhou 510640,Guangdong,China

Received:2014-04-15 Revised:2014-07-15 Online:2014-08-25 Published:2014-07-01
Contact: 郑晓峰(1977-)，男，在职博士生，广东省道路运输管理局工程师，主要从事智能交通和道路交通运输管理研究． E-mail:bobcraft@163.com
About author:郑晓峰(1977-)，男，在职博士生，广东省道路运输管理局工程师，主要从事智能交通和道路交通运输管理研究．
Supported by:
国家自然科学基金资助项目( 61174184) ; 广东省工业科技攻关计划项目( 2008B010200010) ; 广州市科技支撑项目( 2011J4300045)

Abstract

Abstract:

Aiming at the shortcomings of DBSCAN ( Density-Based Spatial Clustering of Applications with Noise) ,this paper presents the concept of the attribute dimension partition by integrating the domain knowledge with thepartition idea.Then,the principles of the cluster merging and the pruning computation are demonstrated.Finally,an optimization method of DBSCAN is put forward based on the cloud computing programming model MapReduce,and the optimization method is verified through the data clustering of a real road transport information system.It isfound that the dataset partition helps to perform the concurrent computation,and the proposed optimization methodis superior to common statistical methods.

Key words: road transportation, DBSCAN, attribute dimension, partition, MapReduce, clustering

CLC Number:

U495

Zheng Xiao-feng Xu Jian-min Lu Kai. Data Clustering of Ｒoad Transportation Information System Based on Attribute Dimension Partition and MapＲeduce[J]. Journal of South China University of Technology (Natural Science Edition), 2014, 42(8): 122-128,135.

[1]	LIU Yijun, WANG Jiada, ZHONG Shijie, et al.. Fast Multi-View Clustering Based on Uniform Label Matrix [J]. Journal of South China University of Technology(Natural Science Edition), 2023, 51(9): 110-119.
[2]	WANG Xuewu, FANG Junyu, GAO Jin, et al. Multi-Objective Optimization Based on Improved Distribution of Solutions [J]. Journal of South China University of Technology(Natural Science Edition), 2023, 51(8): 137-148.
[3]	LIN Peiqun, GONG Minping, ZHOU Chuhao. User Portrait Method of Freeway Freight Car for Risk Identification of Freight Transportation [J]. Journal of South China University of Technology(Natural Science Edition), 2023, 51(6): 1-9.
[4]	CHEN Tingzhao, CHEN Yanyan, WANG Zili, et al. Methods of Determining the Range of Non-motorized Travel Influence Area Under the Concept of “Metro Transit Micro-center” [J]. Journal of South China University of Technology(Natural Science Edition), 2022, 50(7): 56-65.
[5]	LIU Xiaolan, SHI Zongyu, YE Zehui, et al. Anchor Graph Based Low-Rank Incomplete Multi-View Subspace Clustering [J]. Journal of South China University of Technology(Natural Science Edition), 2022, 50(12): 60-70.
[6]	CHEN Jiqing, SHU Xiaoxiong, LAN Fengchong, et al. Construction of Autonomous Vehicles Test Scenarios with Typical Dangerous Accident Characteristics [J]. Journal of South China University of Technology (Natural Science Edition), 2021, 49(5): 1-8.
[7]	LIANG Jingzhang, HUANG Xingshu, WU Lijuan, et al. Clustering Method of Power Load Profiles Based on KPCA and Improved K-means [J]. Journal of South China University of Technology (Natural Science Edition), 2020, 48(6): 143-150.
[8]	LI Zhi, CHEN Yehang, FENG Bao, et al. Cerebral Infarction Image Segmentation Based on Active Contour Model [J]. Journal of South China University of Technology (Natural Science Edition), 2020, 48(5): 102-111,124.
[9]	ZHENG Sifan, WANG Weixing, HE Zhanhua, et al. Research on Swing Amplitude Detection of Automobile Wiper with Two Granularity Optical Flow Manifold Learning#br# [J]. Journal of South China University of Technology (Natural Science Edition), 2020, 48(1): 123-132.
[10]	LIU Xiaolan PAN Gan YI Miao LI Zhipeng. Distributed Low-rank Tensor Subspace Clustering Algorithm [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(8): 77-83,95.
[11]	DAI Xiang HUANG Xifeng TANG Rui JIANG Mengting CHEN Xingshu WANG Haizhou LUO Liang. Subtopic Detection Algorithm Based on Hierarchical Clustering [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(8): 84-95.
[12]	ZHENG Meiguang YANG Jiao CHANG Chenglong HU Zhigang. Unstable Data Partition Recognition Algorithm for Unstructured Cloud Data Management System [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(8): 105-112.
[13]	WU Wenjing JING Peng JIA Hongfei ZHANG Minghang. Low Carbon Travel Intention Data Mining for Residents Based on K-means Clustering and Random Forest Algorithm [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(7): 105-111.
[14]	CHEN Weiya PAN Xin FANG Xiaoping. Short-term Prediction of Passenger Flow on Bus Routes Based on K-means Clustering Combination Models [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(4): 83-89,113.
[15]	HONG Xiaobin ZI Wenjiang YU Rong LUO Zongqiang HE Zhenwei . Fusion Assessment on the Credibility of Cloud Nondestructive Testing for Large-Scale Steel Structures [J]. Journal of South China University of Technology (Natural Science Edition), 2019, 47(3): 70-77.

Data Clustering of Ｒoad Transportation Information System Based on Attribute Dimension Partition and MapＲeduce

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments