基于Kokkos模板元编程的性能可移植求解器开发

doi:10.11871/jfdc.issn.2096-742X.2024.01.002

数据与计算发展前沿 ›› 2024, Vol. 6 ›› Issue (1): 12-20.

CSTR: 32002.14.jfdc.CN10-1649/TP.2024.01.002

doi: 10.11871/jfdc.issn.2096-742X.2024.01.002

• 专题:超算互联网及应用 • 上一篇下一篇

基于Kokkos模板元编程的性能可移植求解器开发

郑亮^1,^*(),黎坤运¹,周兴彬¹,李永辉¹,于要杰¹,向玉开¹,胡健¹,柴华¹,郭黎^1,²

1.国家超级计算成都中心，四川成都 610213
2.成都数据集团，四川成都 610041

收稿日期:2023-09-29 出版日期:2024-02-20 发布日期:2024-02-21
通讯作者: * 郑亮（E-mail: zhengl@cdcszx.cn/23798906@qq.com）
作者简介:郑亮，国家超级计算成都中心（成都超算中心运营管理有限公司），副研究员，副总经理，高性能计算部部长，长期从事高性能计算研究，主要研究方向为并行计算、工业软件和计算地球动力学。
本文负责论文撰写，设计与开发ChipSum。ZHENG Liang is the deputy manager of the National Supercomputing Center in Chengdu, and the director of the Department of High Performance Computing. He has long been engaged in the research of high performance computing. His major research interests include parallel computing, industrial software development, and computational geodynamics.
In this paper, he is responsible for the paper writing, designing and developing ChipSum.
E-mail: zhengl@cdcszn.cn/23798906@qq.com
基金资助:
工信部产业技术基础公共服务平台面向人工智能创新应用先导区的应用场景公共服务平台建设项目-成都人工智能应用发展产业技术基础公共服务平台建设(CEIEC-2021-ZM02-0166);四川省科技计划面向工业软件的作业管理技术研究与应用(2022YFG0040);光合基金(GHFUND202107014373)

Development of Performance Portable Solver Based on Kokkos Template Metaprogramming

ZHENG Liang^1,^*(),LI Kunyun¹,ZHOU Xingbin¹,LI Yonghui¹,YU Yaojie¹,XIANG Yukai¹,HU Jian¹,CHAI Hua¹,GUO Li^1,²

1. National Supercomputing Center in Chengdu, Chengdu, Sichuan 610213, China
2. Chengdu Data Group, Chengdu, Sichuan 610041, China

Received:2023-09-29 Online:2024-02-20 Published:2024-02-21

摘要/Abstract

摘要：

【目的】解决面向多样化异构计算架构的求解器应用编程问题。【应用背景】超级计算机的硬件架构日益多样化，新的异构架构因生态不够完善，往往导致软件移植研发门槛过高、研发周期过长，以及存在针对不同硬件反复适配、移植等问题。【方法】在Kokkos代数算子库基础上，开发一套面向国产E级计算环境的“性能可移植”模板元接口开源框架，用于线性代数求解器编程。【结果】本文给出其用于Krylov子空间算法的简单编程示范，实现了面向国产异构处理器的线性代数求解器移植，部分求解器相较于10核超线程Xeon CPU有数十倍以上加速。【结论】性能可移植编程可成为应对多样化异构计算的解决方案。

关键词: 性能可移植, Kokkos, 模板元编程, 线性代数求解器

Abstract:

[Objective] This paper provides a solution to programming of linear algebra problem solvers oriented to multiple heterogeneous computing architectures. [Context] The hardware architecture of supercomputers is becoming increasingly diverse. Due to incomplete software ecosystem, programming on new hardware is difficult, for example, the development cycle is too long for new hardware, repeated adaptation and development are needed for different hardware. [Methods] Using the Kokkos library to port linear algebra operators can help development of a metaprogramming framework using performance portable templates for domestic exa-scale computing environment. [Results] The Krylov sub-space algorithm are implemented as a demonstration for programming linear algebra problem solvers on a domestic heterogeneous device, resulting in at least 10x speedup compared to a 10-core hyperthreading Xeon CPU. [Conclusions] Performance portable programming is a solution for programming diverse heterogeneous computing systems.

Key words: performance portability, Kokkos, template metaprogramming, linear algebra problem solver

郑亮, 黎坤运, 周兴彬, 李永辉, 于要杰, 向玉开, 胡健, 柴华, 郭黎. 基于Kokkos模板元编程的性能可移植求解器开发[J]. 数据与计算发展前沿, 2024, 6(1): 12-20.

ZHENG Liang, LI Kunyun, ZHOU Xingbin, LI Yonghui, YU Yaojie, XIANG Yukai, HU Jian, CHAI Hua, GUO Li. Development of Performance Portable Solver Based on Kokkos Template Metaprogramming[J]. Frontiers of Data and Computing, 2024, 6(1): 12-20, https://cstr.cn/32002.14.jfdc.CN10-1649/TP.2024.01.002.

图/表 9

图1

图2

图3

图4

图5

图6

图7

图8

表1

参考文献 22

[1]	MESSINA P. The exascale computing project[J]. Computing in Science & Engineering, 2017, 19(3): 63-67.
[2]	DUBEY A, MCINNES L C, THAKUR R, et al. Performance portability in the exascale computing project: exploration through a panel series[J]. Computing in Science & Engineering, 2021, 23(5): 46-54.
[3]	DEAKIN T, MCINTOSH-SMITH S, PRICE J, et al. Performance portability across diverse computer architectures[C]// 2019 IEEE/ACM International Workshop on Performance, Portability and Productivity in HPC (P3HPC). IEEE, 2019: 1-13.
[4]	EDWARDS H C, TROTT C R, SUNDERLAND D. Kokkos: Enabling manycore performance portability through polymorphic memory access patterns[J]. Journal of parallel and distributed computing, 2014, 74(12): 3202-3216. doi: 10.1016/j.jpdc.2014.07.003
[5]	EDWARDS H C, TROTT C R. Kokkos: Enabling performance portability across manycore architectures[C]// 2013 Extreme Scaling Workshop (xsw 2013). IEEE, 2013: 18-24.
[6]	BECKINGSALE D A, BURMARK J, HORNUNG R, et al. RAJA: Portable performance for large-scale scientific applications[C]// 2019 ieee/acm international workshop on performance, portability and productivity in hpc (p3hpc). IEEE, 2019: 71-81.
[7]	REGULY I Z. Evaluating the performance portability of SYCL across CPUs and GPUs on bandwidth-bound applications[J]. arXiv preprint arXiv:2309.10075, 2023.
[8]	BARATTA I, RICHARDSON C, WELLS G. Performance analysis of matrix-free conjugate gradient kernels using SYCL[C]// International Workshop on OpenCL. 2022: 1-10.
[9]	RUL S, VANDIERENDONCK H, D'HAENE J, et al. An experimental study on performance portability of OpenCL kernels[C]// 2010 Symposium on Application Accelerators in High Performance Computing (SAAHPC'10), 2010.
[10]	谭光明. 高性能计算中的性能工程问题[J]. 数值计算与计算机应用, 2022, 43(4): 343. doi: 10.12288/szjs.s2022-0842
[11]	李韦, 文渊博, 孙广中, 等. 提升高性能计算程序性能可移植性的领域特定语言[J]. 高技术通讯, 2020, 30(2): 141-149.
[12]	HUANG X, HUANG X, WANG D, et al. OpenArray v1. 0: a simple operator library for the decoupling of ocean modeling and parallel computing[J]. Geoscientific Model Development, 2019, 12(11): 4729-4749. doi: 10.5194/gmd-12-4729-2019
[13]	XU M, LI H, SONG Z, et al. An Electric-Thermal-Solid Physical Fields Coupling Calculation Based on FELAC Platform[C]// 2022 IEEE 5th International Conference on Electronics Technology (ICET). IEEE, 2022: 532-536.
[14]	ABRAHAMS D, GURTOVOY A. C++ template metaprogramming: concepts, tools, and techniques from Boost and beyond[M]. New York: Pearson Education, 2004.
[15]	TROTT C R, HAMMOND S D, MOORE S G, et al. Sustainability and Performance thorugh Kokkos: A Case Study with LAMMPS[R]. Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2016.
[16]	MOORE S G. LAMMPS Kokkos Package--Targeting Next-Generation HPC Platforms[R]. Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2016.
[17]	EDWARDS H C, Trott C R, Sunderland D. Kokkos Tutorial: A Trilinos package for manycore performance portability[R]. Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2013.
[18]	MILLS R T, ADAMS M F, BALAY S, et al. Toward performance-portable PETSc for GPU-based exascale systems[J]. Parallel Computing, 2021, 108: 102831. doi: 10.1016/j.parco.2021.102831
[19]	CIESKO J, POLIAKoff D, HOLLMAN D S, et al. Towards generic parallel programming in computer science education with Kokkos[C]// 2020 IEEE/ACM Workshop on Education for High-Performance Computing (EduHPC). IEEE, 2020: 35-42.
[20]	TROTT C, BERGER-VERGIAT L, POLIAKOFF D, et al. The kokkos ecosystem: Comprehensive performance portability for high performance computing[J]. Computing in Science & Engineering, 2021, 23(5): 10-18.
[21]	LIU Y, SCHMIDT B. LightSpMV: Faster CSR-based sparse matrix-vector multiplication on CUDA-enabled GPUs[C]// 2015 IEEE 26th International Conference on Application-specific Systems, Architectures and Processors (ASAP). IEEE, 2015: 82-89.
[22]	LANGR D, TVRDIK P. Evaluation criteria for sparse matrix storage formats[J]. IEEE Transactions on parallel and distributed systems, 2015, 27(2): 428-440. doi: 10.1109/TPDS.2015.2401575

设备	国产异构加速卡	AMDVEGA20	NVIDIAV100
核心频率	1,400 Mhz	1,400 MHz	1,380 Mhz
双精度浮点性能	5.9 FLOPS	6.53 FLOPS	7.0 FLOPS

基于Kokkos模板元编程的性能可移植求解器开发

Development of Performance Portable Solver Based on Kokkos Template Metaprogramming

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献 22

相关文章 0

编辑推荐

Metrics

本文评价