Frontiers of Data and Computing ›› 2019, Vol. 1 ›› Issue (1): 22-34.doi: 10.11871/jfdc.issn.2096.742X.2019.01.004

Special Issue: “数据与计算平台”专刊

Previous Articles     Next Articles

A Brief Review of Theory and Systematic Technologies for Big Data

Qiangsheng Hua1,2,3,4,Zhigao Zheng1,2,3,4,Zhenyu Hu1,2,3,4,Zhiman Zhong1,2,3,4,Changfu Lin1,2,3,4,Feng Zhao1,2,3,4,Hai Jin1,2,3,4,Xuanhua Shi1,2,3,4   

  1. 1. National Engineering Research Center for Big Data Technology and System, Wuhan, Hubei 430074, China
    2. Services Computing Technology and System Lab, Wuhan, Hubei 430074, China
    3. Cluster and Grid Computing Lab, Wuhan, Hubei 430074, China
    4. School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei 430074, China
  • Received:2019-08-30 Online:2019-01-20 Published:2019-10-09

Abstract:

[Objective] The article mainly gives a brief review for big data theory and systems, including the research background, the technical architecture and the key technologies following by estimating future research directions. [Method] On the basis of the brief introduction of the big data processing theory, this paper introduces the key technologies for big data systems by the three aspects: the data parallel processing methods, the Resource Description Framework (RDF) graph data query and matching, and the big data analysis technologies. [Results] The speed of data generation will be accelerated further more in near future, thus how to quickly process the data on the edge side would lead a research trend. [Conclusion] In the future, developing new technologies for big data theory and systems still warrant further attention, on which the researches on data processing by edge computing and fog computing in the scenario of Internet of Things era highlight based.

Key words: low complexity algorithms, data parallelism technologies, QoS mechanism, graph data processing, language model