Journal of South China University of Technology(Natural Science Edition) ›› 2019, Vol. 47 ›› Issue (8): 105-112.doi: 10.12141/j.issn.1000-565X.180497

• Computer Science & Technology • Previous Articles     Next Articles

Unstable Data Partition Recognition Algorithm for Unstructured Cloud Data Management System

ZHENG Meiguang YANG Jiao CHANG Chenglong HU Zhigang   

  1. School of Computer Science and Engineering，Central South University，Changsha 410083，Hunan，China
  • Received:2018-10-08 Revised:2019-04-24 Online:2019-08-25 Published:2019-08-01
  • Contact: 郑美光(1983-)，女，博士，副教授，主要从事云计算、大数据管理优化研究． E-mail:zhengmeiguang@csu.edu.cn
  • About author:郑美光(1983-)，女，博士，副教授，主要从事云计算、大数据管理优化研究．
  • Supported by:
    Supported by the National Natural Science Foundation of China(61602525，61572525)

PDF

1084

Abstract: In the context of big data，data nodes in unstructured cloud data management systems need to process ever-expanding raw data，index data and intermediate data． “Data expansion”will significantly increase the time and energy consumption of cloud data management systems． In order to reduce the data transmission overhead caused by the frequent movement of data in unstructured data management system，an algorithm for identifying unstable data partitions was proposed． Firstly，for the unstructured data management system，the cloud model of data partition was conducted in the storage system by introducing the cloud model theory，and unstable data partitions were identified． Then the relevant algorithm was called to re-layout unstable data partitions． Experimental results show that the unstable data partition identification algorithm can effectively identify unstable data partitions and relayout them，and significantly reduce data transmission overhead．

Key words: big data, cloud model, data partition, data transmission, unstable partition

CLC Number: