数据与计算发展前沿 ›› 2020, Vol. 2 ›› Issue (2): 136-144.

doi: 10.11871/jfdc.issn.2096-742X.2020.02.011

所属专题： “数据分析技术与应用”专刊

• 技术与应用 • 上一篇    下一篇

面向云存储服务的分布式测试框架设计与实现

马振威1,2,张海明1,温亮明1,2,黎建辉1,*()   

  1. 1. 中国科学院计算机网络信息中心,北京 100190
    2. 中国科学院大学,北京 100049
  • 收稿日期:2019-12-23 出版日期:2020-04-20 发布日期:2020-06-03
  • 通讯作者: 黎建辉
  • 作者简介:马振威,中国科学院计算机网络信息中心,中国科学院大学,硕士研究生,主要研究方向为大数据、分布式传输、分布式存储。
    本文中负责分布式测试框架的设计与实现。
    Ma Zhenwei is a master student at Computer Network Information Center of the Chinese Academy of Sciences (University of the Chinese Academy of Sciences). His main research interests are big data, distributed transmission and distributed storage.
    In this paper, he is responsible for the design and implementation of the distributed testing framework.
    E-mail：mazhenwei@cnic.cn|张海明,中国科学院计算机网络信息中心,博士,高级工程师,硕士生导师,主要研究方向为大规模分布式存储、云计算、大数据及数据出版。
    本文中负责测试框架方法介绍与应用分析。
    Zhang Haiming, Ph.D., is a senior engineer and the master tutor at Computer Network Information Center, Chinese Academy of Sciences. His main research directions are large-scale distributed storage, cloud computing, big data and data publishing.
    In this paper, he is responsible for completing the introduction of the test framework methods and application analysis.
    E-mail：hai@cnic.cn|温亮明,中国科学院计算机网络信息中心,中国科学院大学,博士研究生,主要研究方向为科学数据共享、数据资产管理。
    本文中负责综述概括与现状分析。
    Wen Liangming is a PhD candidate at Computer Network Information Center of the Chinese Academy of Sciences (University of the Chinese Academy of Sciences). His main research directions are scientific data sharing and data asset management.
    In this paper, he is responsible for the writing the summary and current analysis in this article.
    E-mail：wenliangming@cnic.cn|黎建辉,中国科学院计算机网络信息中心,博士,研究员,博士生导师,研究方向为大数据资源开放共享、大数据管理技术、大数据计算与分析技术等。
    本文中负责分布式平台方法原理和结论展望。
    Li Jianhui, Ph.D., is a research fellow and the Ph.D. supervisor at Computer Network Information Center, Chinese Academy of Sciences. His research directions are open sharing of big data resources, big data management technology, big data computing and analysis technology.
    In this paper, he is responsible for the summarizing the principle and conclusion of the distributed platform methods.
  • 基金资助:
    中国科学院战略性先导科技专项(A类)子课题“大数据资源库与门户系统”(XDA19020104)

Design and Implementation of a Distributed Testing Framework for Cloud Storage Services

Ma Zhenwei1,2,Zhang Haiming1,Wen Liangming1,2,Li Jianhui1,*()   

  1. 1. Computer Network Information Center, Chinese Academy of Sciences, Beijing 100190, China
    2. University of Chinese Academy of Sciences, Beijing 100049, China
  • Received:2019-12-23 Online:2020-04-20 Published:2020-06-03
  • Contact: Jianhui Li

RichHTML

42

PDF

679

摘要：

【目的】分布式测试框架是一种通过集群进行大规模测试的方法,它通过中控系统对大量廉价主机进行控制,使其以一种标准化模式进行工作,对于规模庞大的待测试系统具有重要的现实意义。【方法】文章首先介绍了分布式执行集群部署方案和管理中控架构,设计了包含三个实现模块的测试框架流程。然后介绍了分布式测试框架的软硬件环境和对象云存储系统架构,最后通过对象云存储系统进行单桶测试和吞吐量测试。【结论】测试结果表明,面向云存储服务的分布式测试框架具有快速、多模式、高效等特性,有效满足大规模测试系统的性能要求。

关键词: 分布式测试, 数据传输

Abstract:

[Objective] The distributed testing framework is a method for large-scale testing by clusters. It controls a large number of cheap hosts through a central control system and makes them work in a standardized mode. It has important practical significance for testing large-scale systems. [Methods] The article first introduces the distributed task cluster deployment scheme, the master central control architecture, and the design of a testing framework consisting of three implementation modules. Then introduces the software and hardware environment of the distributed test framework and the object cloud storage system architecture. In the end, the storage system performing single bucket tests and throughput tests is presented. [Conclusions] The test results show that the large-scale distributed testing framework has characteristics such as fast, multi-mode, and high efficiency, which satisfy the performance requirements of large-scale system testing.

Key words: distributed testing, data transmission