数据与计算发展前沿 ›› 2023, Vol. 5 ›› Issue (5): 35-45.

CSTR: 32002.14.jfdc.CN10-1649/TP.2023.05.004

doi: 10.11871/jfdc.issn.2096-742X.2023.05.004

• 专刊:数据要素安全高效流通的关键技术 • 上一篇    下一篇

一种面向超大城市治理的数据高效跨域流通技术框架

贾晓丰1(),高嵩1,周琰2,薛钦亮2,范举3,*()   

  1. 1.北京市大数据中心，数据管理部，北京 100101
    2.中国人民大学，信息学院, 北京 100872
    3.中国人民大学，数据工程与知识工程教育部重点实验室，北京 100872
  • 收稿日期:2023-05-04 出版日期:2023-10-20 发布日期:2023-10-31
  • 通讯作者: 范举（E-mail: fanj@ruc.edu.cn）
  • 作者简介:贾晓丰，北京市大数据中心，数据管理部部长，教授级高工，博士，主要研究方向包括复杂系统、联邦智能、深度关系学习等。
    本文主要承担工作为研究方向和主要创新点的提出。
    JIA Xiaofeng, Ph.D., is the Director of the Department of Data Management of Beijing Big Data Center, a professor-level senior engineer. His main research interests include complex systems, federated intelligence, and deep relational learning.
    In this paper, he is responsible for proposing research directions and main innovative points.
    E-mail: jiaxf@jxj.beijing.gov.cn|范举，中国人民大学数据工程与知识工程教育部重点实验室，教授，博士生导师，主要研究方向为数据治理技术与系统、智能数据库系统等。
    本文主要承担工作为创新点的提出与文章的修改。
    FAN Ju, Ph.D., is a professor and doctoral supervisor of the Key Laboratory of Data Engineering and Knowledge Engineering of the Ministry of Education of Renmin University of China. His main research interests include data governance technology and systems, intelligent database systems, etc.
    In this paper, he is responsible for proposing innovative points and revising the article.
    E-mail: fanj@ruc.edu.cn
  • 基金资助:
    国家重点研发计划“物联网与智慧城市关键技术及示范”重点专项(2021YFB2104800)

A Technical Framework of Efficient Cross-Domain Data Circulation for Mega-City Governance

JIA Xiaofeng1(),GAO Song1,ZHOU Yan2,XUE Qinliang2,FAN Ju3,*()   

  1. 1. Department of Data Management, Beijing Big Data Centre, Beijing 100101, China
    2. School of Information, Renmin University of China, Beijing 100872, China
    3. Key Laboratory of Data Engineering and Knowledge Engineering, Renmin University of China, Beijing 100872, China
  • Received:2023-05-04 Online:2023-10-20 Published:2023-10-31

RichHTML

8

PDF

76

摘要：

【目的】 超大城市作为一个大规模复杂系统，具有高维全域性、动态复杂性、快速成长性的显著特征，其科学治理需要解决数据在跨领域、跨层级、跨主体等跨域场景下的高效流通问题。【方法】 针对超大城市中数源海量、数据分散、场景复杂等主要挑战，本文提出数据高效跨域流通技术框架，该框架包括基于目录生成的分布式数据标识、基于数据路由的多主体跨域调度和基于算法切片的安全协同计算等关键技术。【结果】 基于该框架构建了多层级、多粒度的目录链系统，面向北京市，支持了数千个分散数据源、上万类异质数据结构、千亿级实时数据的数据高效跨域流通，并在智能派单、证照验证等场景下进行了验证。【结论】 该框架为面向超大城市治理的数据高效跨域流通提供了一种可行技术路径。

关键词: 复杂系统, 数据流通, 数据标识, 跨域调度, 协同计算

Abstract:

[Objective] As a large-scale complex system, megacities possess significant characteristics such as high-dimensional globality, dynamic complexity, and rapid growth. Scientific governance of megacities requires efficient cross-domain data circulation across different fields, levels, and entities. [Methods] In response to the major challenges in megacities such as massive data sources, data decentralization, and complex scenarios, this paper proposes a data-efficient cross-domain circulation technology framework. The framework includes key technologies such as distributed data identification based on directory generation, cross-domain scheduling based on data routing, and secure collaborative computing based on algorithm slicing. [Results] Based on this framework, a multi-level and multi-granularity directory chain system is constructed for Beijing, which supports efficient cross-domain data circulation for thousands of scattered data sources, tens of thousands of heterogeneous data structures, and real-time data in the scale of hundreds of billions. [Conclusions] The framework is validated in scenarios such as intelligent dispatching and license verification, providing a feasible technical path for data-efficient cross-domain circulation in megacity governance.

Key words: complex system, data circulation, data identification, cross domain scheduling, collaborative computing