数据与计算发展前沿 ›› 2022, Vol. 4 ›› Issue (6): 29-37.

CSTR: 32002.14.jfdc.CN10-1649/TP.2022.06.004

doi: 10.11871/jfdc.issn.2096-742X.2022.06.004

• 专刊：东数西算：开启算力经济时代的世纪工程（下） • 上一篇    下一篇

基于算力网络的大数据计算资源智能调度分配方法

金天骄1(),栗蔚2,*()   

  1. 1.中国移动通信集团浙江有限公司，浙江 杭州 310030
    2.中国信息通信研究院，北京 100191
  • 收稿日期:2022-08-04 出版日期:2022-12-20 发布日期:2022-12-20
  • 通讯作者: 栗蔚
  • 作者简介:金天骄，中国移动通信集团浙江有限公司，算网MSP总监，高级工程师，硕士，杭州市E类人才，10年以上云计算、大数据相关行业咨询、产品开发、技术研究工作经验。
    本文中负责制定论文框架，论文撰写、修改，设计基于算力网络的大数据计算资源智能调度分配方法。
    JIN Tianjiao, MSP director of Chinamobile Zhejiang Co., Ltd. Senior engineer, master, Hangzhou class E talent. He has at least 10 years of working experience in cloud computing, big data related industry consulting, product development, and technology research.
    In this paper, he is responsible for formulating the framework of the paper, writing and modifying the paper, and designing the intelligent scheduling and allocation method of big data computing resources based on computing power network.
    E-mail：jintianjiao@zj.chinamobile.com|栗蔚，中国信息通信研究院，云计算和大数据研究所，副所长，高级工程师，硕士，主要从事云计算等技术研究。
    本文通信作者，承担本文的经费、设计，指导制定论文框架，提供论文中相关数据和材料，论文审定。
    LI Wei, deputy director of the Institute of cloud computing and big data, China Academy of Information and Communications Technology. Senior engineer, master, mainly engaged in cloud computing and other technology research.
    The corresponding author of this paper undertakes the funding and design of this paper, guides the formulation of the paper framework, is responsible for providing relevant data and materials in the paper, and is responsible for the examination and approval of the paper.
    E-mail：liwei3@caict.ac.cn

An Intelligent Scheduling and Allocation Method of Big Data Computing Resources Based on Computing Power Network

JIN Tianjiao1(),LI Wei2,*()   

  1. 1. China Mobile Group Zhejiang Co., Ltd., Hangzhou, Zhejiang 310030, China
    2. China Academy of Information and Communications Technology, Beijing 100191, China
  • Received:2022-08-04 Online:2022-12-20 Published:2022-12-20
  • Contact: LI Wei

RichHTML

0

PDF

751

摘要：

【目的】进入算力时代以来，伴随泛在接入、万物互联，全社会数据量迎来爆发式增长。需要通过算力网络解决大数据计算资源不足、异构算力不足、边缘算力不足等问题。【方法】基于算力网络，重新设计大数据计算体系架构，通过资源编排层提供大数据算力编排、资源封装、统一调度能力。同时利用粒子群算法，智能计算和寻找出资源调度分配的最优节点，使资源分配达到最优平衡。【结果】通过新型的资源调度方法，智能调度各类算力，从根本上解决大数据计算资源不足、异构算力不足、边缘算力不足等问题。【结论】使用基于算力网络的大数据计算资源智能调度分配方法，能够智能调度社会闲散算力、异构算力和边缘算力，从全局角度解决算力需求不足和算力分布不均等问题。

关键词: 算力网络, 大数据计算, 资源调度

Abstract:

[Objective] Since entering the age of computing power, with ubiquitous access and the interconnection of everything, the amount of data in the whole society has ushered in explosive growth. We need to solve the problems of insufficient big data computing resources, heterogeneous computing power, and edge computing power through the computing power network. [Methods] Based on the computing power network, redesign the big data computing architecture, and provide the ability of big data computing power scheduling, resource encapsulation, and unified scheduling through the resource scheduling layer. At the same time, the particle swarm optimization algorithm is used to intelligently calculate and find the optimal node in resource scheduling and allocation, so as to achieve the optimal balance of resource allocation. [Results] Through the new resource scheduling method, intelligent scheduling of all kinds of computing power can fundamentally solve the problems of insufficient big data computing resources, heterogeneous computing power, and edge computing power. [Conclusions] The intelligent scheduling and allocation method of big data computing resources based on computing power networks can intelligently schedule social idle computing power, heterogeneous computing power, and edge computing power, and solve the problem of insufficient computing power demand and uneven distribution of computing power from a global perspective.

Key words: computing power network, big data computing, resource scheduling