BiggerSelfie: Selfie Video Expansion With Hand-Held Camera

Wang, Miao; Shamir, Ariel; Yang, Guo-Ye; Lin, Jia-Rui; Yang, Guowei; Lu, Shao-Ping; Hu, Shi‐Min

doi:10.1109/tip.2018.2859628

Cited by 15 publications

(4 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…e wavelet transform [14][15][16][17] is an effective denoising method related to regularized inversion. In this study, wavelet transform is utilized to decompose and extract the low-and high-frequency information of the blurred image, which is taken as the critical step of the presented deblurring methods.…”

Section: Blurred Li-style Boat-shaped House Restorationmentioning

confidence: 99%

Research on Convolutional Neural Network-Based Virtual Reality Platform Framework for the Intangible Cultural Heritage Conservation of China Hainan Li Nationality: Boat-Shaped House as an Example

Deng

Kim

Shen

2021

Mathematical Problems in Engineering

View full text Add to dashboard Cite

Hainan is located at the southernmost tip of China, since ancient times it has always occupied an important position on the Silk Road. Hainan culture is dominated by minority and marine cultures and has a rich intangible cultural heritage. Hainan has always been committed to the development and utilization of its wide cultural heritage, and the development direction is mainly based on live display and folk activities. In May 2020, the Chinese government announced the establishment of the Hainan Free Trade Port Policy and System, the establishment of a Hainan International Free Trade Zone, and the development of tourism, modern services, and high-tech industry. All these put forward higher requirements for the protection of Hainan’s cultural heritage, not just traditional ways to protect and promote, but also to use the dividends of current scientific and technological development to keep up with the times to protect and promote. The integration of digital technology will be the development direction of cultural heritage and intangible cultural heritage. This paper enumerates and analyzes other cases and academic directions of intangible cultural heritage, combined with the present situation of intangible cultural heritage in Hainan. It also analyzes the predicament of handiwork inheritance in Hainan intangible cultural heritage, expounds the structure, humanistic connotation, and construction skills of Li nationality ship house, and summarizes the role of a novel deep learning convolutional neural network- (CNN-) based virtual reality framework of intangible cultural heritage conservation in promoting the intangible cultural heritage of traditional skills. It also puts forward the scheme and heritage conservation virtual reality content construction and provides the process of building a virtual reality platform for the intangible cultural heritage of ship-shaped houses, which as an example can be used as a reference for intangible cultural heritage researchers in other areas. At the same time, it fills the gap for the artificial intelligence-based digitization of the intangible cultural heritage.

show abstract

Section: Blurred Li-style Boat-shaped House Restorationmentioning

confidence: 99%

Research on Convolutional Neural Network-Based Virtual Reality Platform Framework for the Intangible Cultural Heritage Conservation of China Hainan Li Nationality: Boat-Shaped House as an Example

Deng

Kim

Shen

2021

Mathematical Problems in Engineering

View full text Add to dashboard Cite

show abstract

“…It has been observed that introducing semantic cues to exemplar-based image completion helps to obtain plausible results. Such cues can be specified by user interaction [25,26] or extracted from some large-scale dataset like Internet images [27][28][29][30]. Then exemplar patches are selected and aligned to satisfy the cues such that the completed holes are a good match to the context of the entire image.…”

Section: Image and Video Completionmentioning

confidence: 99%

Rectangling irregular videos by optimal spatio-temporal warping

Wu¹,

Shi

Zhang

2021

Comp. Visual Media

View full text Add to dashboard Cite

Image and video processing based on geometric principles typically changes the rectangular shape of video frames to an irregular shape. This paper presents a warping based approach for rectangling such irregular frame boundaries in space and time, i.e., making them rectangular again. To reduce geometric distortion in the rectangling process, we employ content-preserving deformation of a mesh grid with line structures as constraints to warp the frames. To conform to the original inter-frame motion, we keep feature trajectory distribution as constraints during motion compensation to ensure stability after warping the frames. Such spatially and temporally optimized warps enable the output of regular rectangular boundaries for the video frames with low geometric distortion and jitter. Our experiments demonstrate that our approach can generate plausible video rectangling results in a variety of applications.

show abstract

“…Recently, unstructured video stitching methods have been explored [22,46,47]. Lai et al [22] proposed a neural network for video captured by a linear camera array (see Fig.…”

Section: Panoramic Image and Video Creationmentioning

confidence: 99%

VR content creation and exploration with deep learning: A survey

Wang

Lyu

et al. 2020

Comp. Visual Media

Self Cite

View full text Add to dashboard Cite

Virtual reality (VR) offers an artificial, computer generated simulation of a real life environment. It originated in the 1960s and has evolved to provide increasing immersion, interactivity, imagination, and intelligence. Because deep learning systems are able to represent and compose information at various levels in a deep hierarchical fashion, they can build very powerful models which leverage large quantities of visual media data. Intelligence of VR methods and applications has been significantly boosted by the recent developments in deep learning techniques. VR content creation and exploration relates to image and video analysis, synthesis and editing, so deep learning methods such as fully convolutional networks and general adversarial networks are widely employed, designed specifically to handle panoramic images and video and virtual 3D scenes. This article surveys recent research that uses such deep learning methods for VR content creation and exploration. It considers the problems involved, and discusses possible future directions in this active and emerging research area. Keywords virtual reality; deep learning; neural networks; 360 • image and video virtual content

show abstract

BiggerSelfie: Selfie Video Expansion With Hand-Held Camera

Cited by 15 publications

References 36 publications

Research on Convolutional Neural Network-Based Virtual Reality Platform Framework for the Intangible Cultural Heritage Conservation of China Hainan Li Nationality: Boat-Shaped House as an Example

Research on Convolutional Neural Network-Based Virtual Reality Platform Framework for the Intangible Cultural Heritage Conservation of China Hainan Li Nationality: Boat-Shaped House as an Example

Rectangling irregular videos by optimal spatio-temporal warping

VR content creation and exploration with deep learning: A survey

Contact Info

Product

Resources

About