数据与计算发展前沿 ›› 2021, Vol. 3 ›› Issue (6): 118-126.

doi: 10.11871/jfdc.10-1649.2021.06.009

• 技术与应用 • 上一篇    下一篇

容器技术在高性能计算环境中的应用

卢莎莎(),肖海力(),王小宁()   

  1. 中国科学院计算机网络信息中心,高性能计算技术与应用发展部,北京 100083
  • 收稿日期:2021-03-12 出版日期:2021-12-20 发布日期:2022-01-26
  • 通讯作者: 卢莎莎
  • 作者简介:卢莎莎,中国科学院计算机网络信息中心高性能计算技术与应用发展部,工程师,主要研究方向为高性能计算、软件持续交付技术、容器技术。
    本文中主要承担工作为：SCE中间件和LAMMPS容器化构建、测试,以及相关容器在国家高性能计算环境中的部署。
    LU Shasha is an engineer at Department of High Performance Computing Technology & Application Development, Computer Network Information Center, Chinese Academy of Sciences. Her research interests include high performance computing, continuous delivery and container technology.
    In this paper, she is responsible for building and testing the containers of SCE and LAMMPS, and deploying containers in National High Performance Computing Environment. E-mail: lusha721@sccas.cn;|肖海力,中国科学院计算机网络信息中心高性能计算技术与应用发展部,高级工程师,主要研究方向为网格计算、高性能计算。
    本文中主要承担工作为：容器技术研究、软件部署方案设计。
    XIAO Haili is a senior engineer at Department of High Perfor-mance Computing Technology & Application Development, Computer Network Information Center, Chinese Academy of Sciences. His research interests include grid computing and high performance computing.
    In this paper, he is responsible for the research of container, and overall deployment design.E-mail: haili@sccas.cn;|王小宁,中国科学院计算机网络信息中心高性能计算技术与应用发展部,副研究员,主要研究方向为网格计算、高性能计算。
    本文中主要承担工作为：指导SCE中间件在容器中的安装及配置。
    WANG Xiaoning is an associate professor at Department of High Performance Computing Technology & Application Development, Computer Network Information Center, Chinese Academy of Sciences. Her research interests include grid computing and high performance computing.
    In this paper, she is responsible for the guidance of installing SCE in container.E-mail: wxn@sccas.cn
  • 基金资助:
    国家重点研发计划(2018YFB0204002);中国科学院战略性先导科技专项项目(A类XDA19020101)

Application of Container Technology in High Performance Computing Environment

LU Shasha(),XIAO Haili(),WANG Xiaoning()   

  1. Department of High Performance Computing Technology & Application Development, Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China
  • Received:2021-03-12 Online:2021-12-20 Published:2022-01-26
  • Contact: LU Shasha

RichHTML

31

PDF

398

摘要：

【应用背景】 高性能计算环境中间件SCE部署在多个前端服务器,科学计算应用软件需要在多个超算系统安装,软件与基础编译环境间的适配问题亟需解决。【目的】解决高性能计算环境中SCE中间件与前端服务器、应用软件与超级计算系统之间的兼容性问题,简化软件部署流程。【方法】本文利用Docker技术构建了中间件SCE的容器,利用Singularity技术实现了应用软件的容器化,并在高性能计算环境中多个结点进行了部署验证。【结果】SCE容器能够在环境中正常提供服务,应用软件容器与宿主机性能相当,其中LAMMPS容器运行时间与宿主机误差不超过2.63%。【结论】利用容器技术实现了中间件及应用软件的容器化封装,解决了软件与部署环境的适配问题,降低了软件部署的复杂度,提高了软件管理及运维效率。

关键词: 高性能计算环境, 容器技术, Docker, Singularity

Abstract:

[Background] High performance computing environment middleware SCE is deployed in multiple servers, and scientific computing software needs to be installed in multiple heterogeneous clusters. Therefore, the problem of software adaptation to the basic compiling environment needs to be solved. [Objective] The purpose of the work is to solve the installation problem of SCE and scientific computing software at heterogeneous servers in high performance computing environment, and simplify the software deployment process.[Methods] For the purpose of this work, we build SCE container and application software containers with Docker and Singularity technology and test the containers in several nodes of the high performance computing environment. [Results] The SCE container can run stably in the environment. The scientific computing software containers have roughly equivalent on-host performance with a deviation less than 2.63% for the execution time of LAMMPS. [Conclusions] We build containers of SCE and scientific computing software, optimize the deployment of software, and increase the efficiency of operation and maintenance.

Key words: high performance computing environment, container technology, docker, singularity