数据与计算发展前沿 ›› 2022, Vol. 4 ›› Issue (3): 141-151.

CSTR: 32002.14.jfdc.CN10-1649/TP.2022.03.011

doi: 10.11871/jfdc.issn.2096-742X.2022.03.011

• 技术与应用 • 上一篇    下一篇

面向交通大数据的高速文件传输系统设计与实现

季明辰1,2(),任勇毛2,3(),张运栋2,3(),周慧娟1(),周旭2,3,*(),周艳芳4()   

  1. 1.北方工业大学,北京 100144
    2.中国科学院计算机网络信息中心,北京 100083
    3.中国科学院大学,北京 100049
    4.交通运输部公路科学研究院,北京 100088
  • 收稿日期:2021-08-31 出版日期:2022-06-20 发布日期:2022-06-20
  • 通讯作者: 周旭
  • 作者简介:季明辰,北方工业大学,学士,专业为交通设备与控制工程,研究方向为交通信息处理。
    本文中负责系统传输机制研究与设计,各功能模块的实现与论文撰写。
    JI Mingchen, North China University of Technology, bachelor degree, majoring in traffic equipment and control engineering. His main research interests include traffic information processing.
    In this paper, he is responsible for the research and design of the system transmission mechanism, the realization of each functional module, and the writing of the paper.
    E-mail: jmcncut@163.com|任勇毛,中国科学院计算机网络信息中心,博士,副研究员,CCF高级会员,研究方向为网络拥塞控制与传输协议、网络人工智能。
    本文中负责传输协议研究与传输机制设计指导。
    REN Yongmao, Ph.D., is an associate researcher of the Com-puter Network Information Center, Chinese Academy of Scien-ces, and a senior member of CCF, His main research interests include network congestion control and transmission protocol, network artificial intelligence.
    In this paper, he is responsible for guidance of transmission protocol research and transmission mechanism design.
    E-mail: renyongmao@cstnet.cn|张运栋,中国科学院计算机网络信息中心,硕士研究生,研究方向为网络传输协议。
    本文中负责系统传输协议研究。
    ZHANG Yundong is a master student of the Computer Network Information Center, Chinese Academy of Sciences. His main research interests include network transmission pro-tocol.
    In this paper, he is responsible for the research of the system transmission protocol.
    E-mail: zhangyundong@cnic.cn|周慧娟,北方工业大学,博士,副教授,研究方向为交通控制和交通信息处理。
    本文中负责系统框架研究。
    ZHOU Huijuan, Ph.D., is an associate professor of the North China University of Technology. Her main research inter-ests include traffic control and traffic information processing.
    In this article, she is responsible for system framework research.
    E-mail: zhouhuijuan@ncut.edu.cn|周旭,中国科学院计算机网络信息中心,博士, 研究员,研究领域为未来网络、 移动网络等。
    本文中负责指导系统研究内容与实现途径。
    ZHOU Xu, Ph.D., is a researcher of the Computer Network Information Center, Chinese Academy of Sciences. His main research interests include future network, mobile network, and etc.
    In this paper, he is responsible for guiding the research content and implementation methods of the system.
    E-mail: zhouxu@cnic.cn|周艳芳,交通运输部公路科学研究院,博士,副研究员,研究领域为交通信息化。
    本文中负责系统传输机制设计指导。
    ZHOU Yanfang, Ph.D., is an associate res-earcher of Research Institute of Highway Ministry of Transport. Her main research interests include include traffic informatization.
    In this paper, she is responsible for the guidance of system transmission mechanism design.
    E-mail: yanfangzhou421@163.com
  • 基金资助:
    北京自然科学基金(4202082);北京市“实培计划”项目

Design and Implementation of High-Speed File Transfer System for Big Traffic Data

JI Mingchen1,2(),REN Yongmao2,3(),ZHANG Yundong2,3(),ZHOU Huijuan1(),ZHOU Xu2,3,*(),ZHOU Yanfang4()   

  1. 1. North China University of Technology, Beijing 100144, China
    2. Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China
    3. University of Chinese Academy of Sciences, Beijing 100049, China
    4. Research Institute of Highway Ministry of Transport, Beijing 100088, China
  • Received:2021-08-31 Online:2022-06-20 Published:2022-06-20
  • Contact: ZHOU Xu

RichHTML

12

PDF

55

摘要：

【目的】随着互联网时代的到来,交通行业对数据通信的要求不断提高,加上车联网技术的发展带来大量数据,交通大数据的高速传输需求与有限的网络传输性能之间的矛盾日益增加。【方法】针对这一问题,本文在分析国内外车联网通信以及传输协议研究现状的基础上,结合车联网文件传输方面的应用需求,研究提出了一套基于QUIC（Quick UDP Internet Connection）协议的文件多流并行传输机制,对大数据文件进行压缩、分块、并行传输以及聚合。【结果】本文设计实现了一套面向交通大数据的高速文件传输系统,全面提升了数据传输的性能。【结论】实际的大数据文件传输实验结果表明,本系统在复杂网络环境下,传输效率显著优于传统的文件传输系统。

关键词: 交通大数据, 数据传输, QUIC传输协议, 多流并行传输

Abstract:

[Objective] With the advent of the Internet era, the demand for data communication in the tran-sportation industry is constantly growing. Meanwhile since the development of Internet of Vehicles technology brings a large amount of data, the contradiction between the high-speed transmission demand of traffic big data and the limited network transmission performance is increasing. [Methods] To solve this problem, based on the analysis of the research status of communication and transmission protocols of the Internet of Vehicles in China and abroad, combined with the application requirements of file transmission of the Internet of Vehicles, this paper proposes a set of QUIC protocol-based multi-stream parallel transmission mechanism to compress, block-partition, parallel transmission and aggregation of big data files. [Results] This paper designs and implements a set of high-speed file transfer systems for traffic big data, which comprehensively improves the performance of data transmission. [Conclusions] The experimental results of the actual big data file transfer show that the transmission efficiency of this system is significantly better than the traditional file transfer system under the complex network environment.

Key words: big traffic data, data transmission, QUIC transport protocol, multi-stream parallel transmission