Frontiers of Data and Computing ›› 2024, Vol. 6 ›› Issue (2): 145-155.

CSTR: 32002.14.jfdc.CN10-1649/TP.2024.02.013

doi: 10.11871/jfdc.issn.2096-742X.2024.02.013

• Technology and Application • Previous Articles     Next Articles

The Design and Implementation of Scientific Data Transfer System for High Energy Photon Source

ZHUANG Bo*(),HU Hao,QI Fazhi,ZENG Shan   

  1. High Energy Physics Institute, Chinese Academy of Sciences, Beijing 100049, China
  • Received:2022-12-28 Online:2024-04-20 Published:2024-04-26

Abstract:

[Objective] High Energy Photon Source (HEPS) is the first High Energy Photon Source in China. It is expected to be completed in 2025. After completion of HEPS, it is expected to produce 200TB of experimental data every day from the 15 public beamlines and stations in the first construction phase. To meet the needs of reading and writing experimental data at different stages, massive experimental data will be stored hierarchically and backed up for a long time. Therefore, it is necessary to transfer these data stably and efficiently between the different storage. [Methods] The HEPS scientific data transfer system is designed with a multi-source DAQ interface, task scheduling, message queue, cluster transfer, log monitoring, configuration management, message notification, etc. [Conclusions] The system realizes efficient and reliable transfer of massive data between different storage media. [Results] The system is now deployed in several line stations of the Beijing Synchrotron Radiation Facility, which is used for the preliminary verification of HEPS data transfer. It runs stably and has good effects, providing terrific data transfer services for researchers and users.

Key words: high energy photon source, reliable transfer, efficient transfer, transfer system