基于虚拟视点的大规模数值模拟的可交互式原位可视化

doi:10.11871/jfdc.issn.2096-742X.2021.04.003

数据与计算发展前沿 ›› 2021, Vol. 3 ›› Issue (4): 30-43.

doi: 10.11871/jfdc.issn.2096-742X.2021.04.003

• 可视化与可视分析专题 • 上一篇下一篇

基于虚拟视点的大规模数值模拟的可交互式原位可视化

石晓霖¹(),毕重科^1,^*(),黄元琪¹(),邓亮²(),王岳青²(),王昉²()

1.天津大学智能与计算学部,天津 300350
2.中国空气动力研究与发展中心,四川绵阳 621000

收稿日期:2021-06-10 出版日期:2021-08-20 发布日期:2021-08-30
通讯作者: 毕重科
作者简介:石晓霖,天津大学智能与计算学部,硕士研究生,主要研究方向为科学可视化。
本文主要承担算法实现和论文修改工作。
SHI Xiaolin is currently a master's student in the College of Intelligence and Computing at Tianjin University, China. His research field includes scientific visualization.
In this paper, he is mainly responsible for algorithms implemen-tation and paper revision.
E-mail: sxl@tju.edu.cn|毕重科,天津大学智能与计算学部,副教授,主要研究科学可视化和高性能计算。
本文主要承担论文总体框架,并指导基于特征区域的三维重建方法的实现。
BI Chongke is currently an associate professor in the College of Intelligence and Computing at Tian-jin University, China. His research interests include scientific visualization and high performance computing.
In this paper, he is responsible for the design for the framework of the paper; and he is the director for the design and implemen-tation of the 3D reconstruction method.
E-mail: bichongke@tju.edu.cn|黄元琪,天津大学智能与计算学部,硕士,主要研究方向为科学可视化和高性能计算。
本文主要承担文献调研和实验。
HUANG Yuanqi received his master's degree from the College of Intelligence and Computing at Tianjin University, China. His research inter-ests include scientific visualization and high performance com-puting.
In this paper, he is mainly responsible for the survey and experimental evaluation.
E-mail: 742023742@qq.com|邓亮,中国空气动力研究与发展中心计算空气动力研究所,助理研究员,主要研究方向为高性能计算和计算流体力学。
本文主要承担指导原位可视化框架的实现。
DENG Liang is currently an assistant researcher of Computational Aerodynamics Institute, China Aerodynamics Research and Development Center. His research interests include high performance computing and CFD.
In this paper, he is the director for design and implementation of the in-situ visualization framework.
E-mail: dengliang11@nudt.edu.cn|王岳青,中国空气动力研究与发展中心计算空气动力研究所,助理研究员,主要研究方向为高性能计算和计算流体力学。
本文主要承担指导虚拟视点合成方法的实现。
WANG Yueqing is currently an assistant researcher of Comput-ational Aerodynamics Institute, China Aerodynamics Research and Development Center. His research interests include high performance computing and CFD.
In this paper, he is the director for design and implementation of the virtual viewpoint synthesis method.
E-mail: yqwang2013@163.com|王昉,中国空气动力研究与发展中心计算空气动力研究所,高级工程师,主要研究方向为高性能计算和计算流体力学。
本文主要承担指导基于特征点的图像拼接方法的实现。
WANG Fang is currently a senior engineer of Computational Aerodynamics Institute, China Aerodyna-mics Research and Development Center. His research interests include high performance computing and CFD.
In this paper, he is the director for design and implementation of the image stitching method.
E-mail: wwangfang@sina.com
基金资助:
国家数值风洞工程项目;国家重点研发计划(2021YFE0108400)

Virtual Viewpoint Based Interactive In-situ Visualization of Large-Scale Simulation

SHI Xiaolin¹(),BI Chongke^1,^*(),HUANG Yuanqi¹(),DENG Liang²(),WANG Yueqing²(),WANG Fang²()

1. College of Intelligence and Computing, Tianjin University, Tianjin 300350, China
2. China Aerodynamics Research and Development Center, Mianyang, Sichuan 621000, China

Received:2021-06-10 Online:2021-08-20 Published:2021-08-30
Contact: BI Chongke

摘要/Abstract

摘要：

【目的】原位可视化是解决大规模数值模拟结果数据难以输出到磁盘进行后处理可视化的有效途径,但是当前的原位可视化主要是为专家提供浏览模式,难以进行交互式探索。所以研究原位可视化的交互技术对帮助专家分析数值模拟结果具有重要意义。【方法】本文提出了一种基于虚拟视点的可交互式原位可视化方法。为了解决原位可视化图像采样不全的问题,我们设计了基于深度图的虚拟视点合成方法,补充了用于三维重建的虚拟视点图像。然后为了展示数值模拟结果的整体特征,将生成的虚拟视点图像和原始图像进行图像拼接。最后对拼接而成的完整图像进行三维重建生成了可供交互的模型,解决了原位可视化图像难以帮助专家在空间上交互的问题。【结果】我们使用了二维和三维等不同数值模拟生成的原位可视化图像进行实验验证,证明了本文提出的可交互式原位可视化方法的有效性。【局限】图像处理技术在不断发展,未来希望对原位可视化数据与图像处理的交互式结合进行更多的探索。【结论】本文设计了一种基于虚拟视点的可交互式原位可视化方法,可以有效地帮助专家准实时观察和分析大规模数值模拟所有中间结果的细节。

关键词: 原位可视化, 交互式操作, 图像处理

Abstract:

[Objective] In-situ visualization is an effective way to solve the problem of outputting large-scale numerical simulation results to the hard disk for post-processing visualization. However, the current in-situ visualization methods mainly provide browsing mode for experts, which fails to conduct interactive exploration. Therefore, the study of interactive technology for in-situ visualization is essential for helping experts in analyzing the results of numerical simulations. [Methods] We present an interactive in-situ visualization method based on virtual viewpoint to help experts visually explore numerical simulations. Firstly, in order to resolve the problem of incomplete sampling of in-situ visualization images, a virtual viewpoint synthesis method is designed to supplement virtual viewpoint images for 3D reconstruction. Then, based on raw images and the generated virtual viewpoint images, an image stitching method is proposed to show the overall characteristics of in-situ visualization images. Finally, the interactive model can be generated through 3D reconstruction from the stitched images. [Results] In order to demonstrate the effectiveness of the proposed interactive in-situ model, several different numerical simulations are carried out. As a result, the generated in-situ visualization results can be interactively explored by domain scientists. [Limitations] Because that the image processing technology is constantly evolving, we hope to conduct more explorations on combination of in-situ visualization image data and interactive image processing in the future. [Conclusions] In this paper, a virtual viewpoint-based interactive in-situ visualization method is proposed. It can successfully help experts to interactively explore the intermediate output data of large-scale simulation.

Key words: in-situ visualization, interactive operation, image processing

石晓霖,毕重科,黄元琪,邓亮,王岳青,王昉. 基于虚拟视点的大规模数值模拟的可交互式原位可视化[J]. 数据与计算发展前沿, 2021, 3(4): 30-43.

SHI Xiaolin,BI Chongke,HUANG Yuanqi,DENG Liang,WANG Yueqing,WANG Fang. Virtual Viewpoint Based Interactive In-situ Visualization of Large-Scale Simulation[J]. Frontiers of Data and Computing, 2021, 3(4): 30-43.

图/表 8

图1

图2

图3

图4

图5

图6

图7

图8

参考文献 24

[1]	单桂华, 田东, 谢茂金, 等. 千万亿次科学计算的原位可视化[J]. 计算机辅助设计与图形学学报, 2013,25(3):286-293.
[2]	王昉, 李思昆, 赵丹, 等. 原位可视化研究与应用进展[J]. 系统仿真学报, 2015,27(10):2589-2599.
[3]	Wong P C, Shen H W, Johnson C R, et al. The top 10 challenges in extreme-scale visual analytics[J]. IEEE Com-puter Graphics and Applications, 2012,32(4):63-67.
[4]	Ma K-L, Wang C, Yu H, et al. In-situ processing and visualization for ultrascale simulations[J]. Journal of Physics: Conference Series. IOP Publishing, 2007,78(1):012-043.
[5]	Kageyama A, Yamada T. An approach to exascale visua-lization: interactive viewing of in-situ visualization[J]. Com-puter Physics Communications, 2014,185(1):79-85.
[6]	Ahrens J, Jourdain S, O'Leary P, et al. An image-based approach to extreme scale in situ visualization and ana-lysis[C]. SC'14: Proceedings of the International Confer-ence for High Performance Computing, Networking, Storage and Analysis. IEEE, 2014: 424-434.
[7]	陈呈, 赵丹, 王岳青, 等. NNW-TopViz流场可视分析系统[J]. 航空学报, 2021,42(9):625-747.
[8]	Merkle P, Morvan Y, Smolic A, et al. The effects of mul-tiview depth video compression on multiview rendering[J]. Signal Processing Image Communications, 2009,24(1-2):73-88. doi: 10.1016/j.image.2008.10.010
[9]	Gao L, Chen H, Liu C, et al. A newly virtual view gene-ration method based on depth image[C]. 2012 IEEE 11th International Conference on Signal Processing. IEEE, 2012,2:1088-1091.
[10]	Zhu S, Xu H, Yan L. An improved depth image based virtual view synjournal method for interactive 3D video[J]. IEEE Access, 2019,7:115171-115180. doi: 10.1109/Access.6287639
[11]	Zhen H, Li Y, Li J. Image stitch algorithm based on SIFT and MVSC[C]. 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery. IEEE, 2010,6:2628-2632.
[12]	Lowe D G. Distinctive image features from scale-invar-iant keypoints[J]. International Journal of Computer Vision, 2004,60(2):91-110. doi: 10.1023/B:VISI.0000029664.99615.94
[13]	Han X F, Laga H, Bennamoun M. Image-based 3D object reconstruction: state-of-the-art and trends in the deep learning era[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019,43(5):1578-1604. doi: 10.1109/TPAMI.34
[14]	Rivi M, Calori L, Muscianisi G, et al. In-situ visualiza-tion: state-of-the-art and some use cases[J]. PRACE White Paper, 2012: 1-18.
[15]	Whitlock B, Favre J M, Meredith J S. Parallel in situ coupling of simulation with a fully featured visualization system[C]. Proceedings of the 11th Eurographics Confer-ence on Parallel Graphics and Visualization (EGPGV). Aire-la-Ville, Switzerland: Eurographics Association, 2011,10:101-109.
[16]	Fabian N, Moreland K, Thompson D, et al. The paraview coprocessing library: a scalable, general purpose in situ visualization library[C]. 2011 IEEE symposium on large data analysis and visualization. IEEE, 2011: 89-96.
[17]	Dutta S, Chen C M, Heinlein G, et al. In situ distribution guided analysis and visualization of transonic jet engine simulations[J]. IEEE Transactions on Visualization and Computer Graphics, 2016,23(1):811-820. doi: 10.1109/TVCG.2016.2598604
[18]	Dutta S, Shen H W, Chen J P. In situ prediction driven feature analysis in jet engine simulations[C]. 2018 IEEE Pacific Visualization Symposium (PacificVis). IEEE, 2018: 66-75.
[19]	Bay H, Tuytelaars T, Gool L J V. SURF: Speeded up robust features[C]. European conference on computer vision. Spr-inger, Berlin, Heidelberg, 2006: 404-417.
[20]	Chum O, Matas J, Kittler J. Locally optimized RANSAC[C]. Joint Pattern Recognition Symposium. Springer, Berlin, Heidelberg, 2003: 236-243.
[21]	Abdel-Hakim A E, Farag A A. CSIFT: A SIFT descriptor with color invariant characteristics[C]. 2006 IEEE computer society conference on computer vision and pattern recogni-tion (CVPR'06). IEEE, 2006,2:1978-1983.
[22]	Hirschmuller H. Stereo processing by semiglobal matching and mutual information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008,30(2):328-341. doi: 10.1109/TPAMI.2007.1166
[23]	Ayachit U, Whitlock B, Wolf M, et al. The SENSEI generic in situ interface[C]. 2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV). IEEE, 2016: 40-44.
[24]	Ayachit U, Bauer A, Duque E P N, et al. Performance analysis, design considerations, and applications of extreme-scale in situ infrastructures[C]. SC'16: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 2016: 921-932.

基于虚拟视点的大规模数值模拟的可交互式原位可视化

Virtual Viewpoint Based Interactive In-situ Visualization of Large-Scale Simulation

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

图/表 8

参考文献 24

相关文章 0

编辑推荐

Metrics

本文评价