STSRNet: Deep Joint Space–Time Super-Resolution for Vector Field Visualization

DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualization

“…This makes unsupervised learning, particularly self-supervised learning, a suitable candidate for accomplishing such tasks. Thus, investigating the underexplored self-supervised learning solutions for making predictions or recommendations will certainly boost [2], [27], [45], [46], [47], [49], [50] [12], [63] [35], [57] [11], [15] [24] + [51], [53], [54], [55] , [56], [76], [84] [70], [158] [71], [85] [31], [40] [126], [131], [156] + , [160], [162] [159]…”

“…We also refer to their research tasks when categorizing the surveyed papers in the respective tables according to learning type, network architecture, loss function, and evaluation metric. The description [51] TSR-TVD TVCG Han and Wang [50] SSR-TVD TVCG Han et al [55] STNet TVCG Wurster et al [167] arXiv Guo et al [47] SSR-VFD PVIS Jakob et al [76] TVCG Sahoo and Berger [126] IA-VFS EVIS An et al [2] STSRNet CG&A Han and Wang [53] TSR-VFD C&G Xie et al [168] tempoGAN TOG Werhahn et al [162] CGIT Wang et al [156] DeepOrganNet TVCG Lu et al [109] neurcomp CGF Weiss et al [160] fV-SRN arXiv Shi et al [131] GNN-Surrogate TVCG Han and Wang [54] VCNet VI Liu et al [106] JOV Han et al [49] CG&A Gu et al [45] VFR-UFD CG&A Han et al [56] V2V TVCG Gu et al [46] Scalar2Vec PVIS Kim et al [84] Deep Fluids CGF Chu et al [27] TOG Wiewel et al [163] LSP CGF Wiewel et al [164] LSS CGF Berger et al [12] TVCG Hong et al [70] DNN-VolVis PVIS He et al [63] InSituNet TVCG Weiss et al [159] TVCG Weiss et al [161] TVCG Weiss and Navab [158] DeepDVR arXiv He et al [62] CECAV-DNN VI Tkachev et al [143] TVCG Hong et al [71] PVIS Kim and Günther [85] CGF Han et al [57] arXiv Yang et al [169] JOV Shi and Tao [130] TIST Engel and Ropinski …”

“…Data generation tasks produce or reconstruct data or models from low-resolution versions (e.g., [182]), feature representations (e.g., [49]), or lower-dimensional counterparts (e.g., [156]) [ ]. They also address data translation (e.g., [56]) [ ] (e.g., translating from one variable sequence to another or from an input field to another that satisfies specific properties or constraints) and extrapolation (e.g., [163]) [182] low-resolution volume super-resolution volume Han and Wang [51] TSR-TVD two end volumes intermediate volumes Han and Wang [50] SSR-TVD low-resolution volume super-resolution volume Han et al [55] STNet low-resolution two end volumes super-resolution intermediate volumes Wurster et al [167] low-resolution volume multi-resolution super-resolution volume Guo et al [47] SSR-VFD low-resolution field super-resolution field Jakob et al [76] low-resolution flow map super-resolution flow map Sahoo and Berger [126] IA-VFS low-resolution field super-resolution field An et al [2] STSRNet low-resolution two end fields super-resolution intermediate fields Han and Wang [53] TSR-VFD two end volumes intermediate volumes Xie et al [168] tempoGAN low-resolution volume super-resolution volume Werhahn et al [162] low-resolution volume super-resolution volume Wang et al [156] DeepOrganNet 3D/4D-CT projection or X-ray image 3D/4D lung model Lu et al [109] neurcomp voxel coordinate scalar value Weiss et al [160] fV-SRN voxel coordinate density or color Shi et al [131] GNN-Surrogate simulation parameters output field with adaptive resolution Han and Wang [54] VCNet incomplete volume complete volume Liu et al [106] volume patch feature vector Han et al [49] low-resolution field high-resolution field Gu et al [45] VFR-UFD low-quality fields high-quality fields Han et al [56] V2V source variable target variable Gu et al [46] Scalar2Vec scalar field volume vector field volume Kim et al [84] Deep Fluids velocity vector field, solver parameters divergence-free velocity field Chu et al…”

“…TSR-VFD utilizes two networks: InterpolationNet and MaskNet, to learn different scales of the data and can achieve a maximal interpolation step of 9. An et al [2] proposed STSRNet, a joint space-time super-resolution framework for vector field visualization. STSRNet includes two stages: the first one synthesizes intermediate frames given the two end frames at the low spatial resolution, and the second one upscales these intermediate frames to high spatial resolution.…”

“…"adversarial" and "compression" are abbreviated as "adv" and "comp", respectively. [46](magnitude), [47](magnitude) [51](adv) [27](adv) CD 2 [2](angle) [2](temporal), [56](feature) [50](adv), [50](content), [50](feature) [54](adv) [162](adv) CD 2 [46](angle) [70], [84](stream function) [51](feature), [51](volumetric), [53], [54] [70](adv) [167](adv) CD 2 [47](angle) [103], [106], [131] [55](adv), [55](cycle), [55](volumetric) [106](adv) [162], [163] [56](adv), [56](volumetric) [168](adv) [164](AE), [164](split) [109](reconstruction), [117] [167](reconstruction), [168] [126](vector), [143], [163], [182] image [12], [160] [158]…”