Removal of water‐surface reflection effects with a temporal minimum filter for UAV‐based shallow‐water photogrammetry

Abstract

The recent development of structure‐from‐motion (SfM) and multi‐view stereo (MVS) photogrammetry techniques has enabled semi‐automatic high‐resolution bathymetry using aerial images taken by consumer‐grade digital cameras mounted on unmanned aerial vehicles (UAVs). However, the applicability of these techniques is sometimes limited by sun and sky reflections at the water surface, which render the point‐cloud density and accuracy insufficient. In this research, we present a new imaging technique to suppress the effect of these water‐surface reflections. In this technique, we order a drone to take a short video instead of a still picture at each waypoint. We then apply a temporal minimum filter to the video. This filter extracts the smallest RGB values in all the video frames for each pixel, and composes an image with greatly reduced reflection effects. To assess the performance of this technique, we applied it at three small shallow‐water sites. Specifically, we evaluated the effect of the technique on the point cloud density and the accuracy and precision of the photogrammetry. The results showed that the proposed technique achieved a far denser point cloud than the case in which a randomly chosen frame was used for each waypoint, and also showed better overall accuracy and precision in estimating water‐bottom elevation. The effectiveness of this new technique should depend on the surface wave state and sky radiance distribution, and this dependence, as well as the applicability to large areas, should be investigated in future research. Copyright © 2018 John Wiley & Sons, Ltd.

Applications of Unmanned Aerial Systems (UASs) in Hydrology: A Review

“…They demonstrated that it is possible to quantify submerged geomorphic changes with levels of accuracy of less than 4 cm similar to that from exposed areas without the need of calibration data and that, using nadir imagery, the results obtained after different refraction corrections are practically the same. Partama et al [54] presented a novel technique based on co-registered image sequences or video frames to reduce the effects of water-surface reflection on UASbased photogrammetry. This promising method, applied in a river reach 0-1.5 m deep, achieved accuracies of 5-15 cm, clarified the reflected signal from the bottom bed and enabled to reduce moving light patterns.…”

Improving Remotely Sensed River Bathymetry by Image‐Averaging

“…This approach could enable depth retrieval from high spatial resolution, glint-contaminated image sequences that would be of no use if analyzed as individual frames. If the glint is extreme, using a temporal minimum filter, as suggested by Partama et al (2018), might be more effective than an averaged image. Other approaches to mitigating sun glint so as to achieve illumination invariance could be explored in future research and include contrast limited adaptive histogram equalization (Dal Sasso et al, 2020) and homomorphic filtering (Nnolim & Lee, 2008).…”

DepthLearn: Learning to Correct the Refraction on Point Clouds Derived from Aerial Imagery for Accurate Dense Shallow Water Bathymetry Based on SVMs-Fusion with LiDAR Point Clouds

“…For mapping an underwater area, authors in [26] used a "floating pyramid" for lifting two cameras. The base of the pyramid was made of Plexiglas for avoiding wave effects and sun glint, which according to [27], sometimes limits the performance of two-media approaches. A contemporary, but similar approach is adopted by [18] for mapping the bottom of a river.…”