Frontiers of Data and Computing ›› 2022, Vol. 4 ›› Issue (3): 141-151.

CSTR: 32002.14.jfdc.CN10-1649/TP.2022.03.011

doi: 10.11871/jfdc.issn.2096-742X.2022.03.011

• Technology and Application • Previous Articles     Next Articles

Design and Implementation of High-Speed File Transfer System for Big Traffic Data

JI Mingchen1,2(),REN Yongmao2,3(),ZHANG Yundong2,3(),ZHOU Huijuan1(),ZHOU Xu2,3,*(),ZHOU Yanfang4()   

  1. 1. North China University of Technology, Beijing 100144, China
    2. Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China
    3. University of Chinese Academy of Sciences, Beijing 100049, China
    4. Research Institute of Highway Ministry of Transport, Beijing 100088, China
  • Received:2021-08-31 Online:2022-06-20 Published:2022-06-20
  • Contact: ZHOU Xu E-mail:jmcncut@163.com;renyongmao@cstnet.cn;zhangyundong@cnic.cn;zhouhuijuan@ncut.edu.cn;zhouxu@cnic.cn;yanfangzhou421@163.com

Abstract:

[Objective] With the advent of the Internet era, the demand for data communication in the tran-sportation industry is constantly growing. Meanwhile since the development of Internet of Vehicles technology brings a large amount of data, the contradiction between the high-speed transmission demand of traffic big data and the limited network transmission performance is increasing. [Methods] To solve this problem, based on the analysis of the research status of communication and transmission protocols of the Internet of Vehicles in China and abroad, combined with the application requirements of file transmission of the Internet of Vehicles, this paper proposes a set of QUIC protocol-based multi-stream parallel transmission mechanism to compress, block-partition, parallel transmission and aggregation of big data files. [Results] This paper designs and implements a set of high-speed file transfer systems for traffic big data, which comprehensively improves the performance of data transmission. [Conclusions] The experimental results of the actual big data file transfer show that the transmission efficiency of this system is significantly better than the traditional file transfer system under the complex network environment.

Key words: big traffic data, data transmission, QUIC transport protocol, multi-stream parallel transmission