Do You See What I See? Coordinating Multiple Aerial Cameras for Robot Cinematography

Bucker, Arthur; Bonatti, Rogerio; Scherer, Sebastian

doi:10.1109/icra48506.2021.9561086

Cited by 13 publications

(6 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This experiment demonstrates the potential of adding high data-load hardware and running more computationally expensive software on the proposed miniature platform with extra user-defined objectives. Swarm tracking can be used in multiview aerial photography and videoing, which have been attracting interest recently (44,45), and they can take comprehensive recordings of the participant and provide more materials for post-editing. To track and record, drones are equipped with extra RGB (red-green-blue) cameras that not only capture vivid videos but also act as representative "high data-load" hardware and simultaneously run video compression, data storing, and object detection to validate the platform's extensibility in computationally expensive tasks.…”

Section: Multidrone Tracking With Target Occlusionmentioning

confidence: 99%

Swarm of micro flying robots in the wild

et al. 2022

View full text Add to dashboard Cite

Aerial robots are widely deployed, but highly cluttered environments such as dense forests remain inaccessible to drones and even more so to swarms of drones. In these scenarios, previously unknown surroundings and narrow corridors combined with requirements of swarm coordination can create challenges. To enable swarm navigation in the wild, we develop miniature but fully autonomous drones with a trajectory planner that can function in a timely and accurate manner based on limited information from onboard sensors. The planning problem satisfies various task requirements including flight efficiency, obstacle avoidance, and inter-robot collision avoidance, dynamical feasibility, swarm coordination, and so on, thus realizing an extensible planner. Furthermore, the proposed planner deforms trajectory shapes and adjusts time allocation synchronously based on spatial-temporal joint optimization. A high-quality trajectory thus can be obtained after exhaustively exploiting the solution space within only a few milliseconds, even in the most constrained environment. The planner is finally integrated into the developed palm-sized swarm platform with onboard perception, localization, and control. Benchmark comparisons validate the superior performance of the planner in trajectory quality and computing time. Various real-world field experiments demonstrate the extensibility of our system. Our approach evolves aerial robotics in three aspects: capability of cluttered environment navigation, extensibility to diverse task requirements, and coordination as a swarm without external facilities.

show abstract

Section: Multidrone Tracking With Target Occlusionmentioning

confidence: 99%

Swarm of micro flying robots in the wild

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Overall, these works present quite valuable contributions for cinematography with multiple UAVs, but the specifics of outdoor scenarios differ in several aspects, as the environment is less controlled: UAVs require more payload to carry on-board cameras with better lenses and equipment for larger range communication; achieving smooth trajectories is more complex due to external factors, such as wind gusts or communication delays; UAV positioning is less accurate in general; etc. [6] does propose quite an interesting multi-UAV architecture which is evaluated outdoors, although it does not consider either user interfaces nor hardware integration.…”

Section: State-of-the-art In Uav Media Productionmentioning

confidence: 99%

A multiple-UAV architecture for autonomous media production

Mademlis

Torres-González

Capitán

et al. 2022

Multimed Tools Appl

View full text Add to dashboard Cite

Cinematography with Unmanned Aerial Vehicles (UAVs) is an emerging technology promising to revolutionize media production. On the one hand, manually controlled drones already provide advantages, such as flexible shot setup, opportunities for novel shot types and access to difficult-toreach spaces and/or viewpoints. Moreover, little additional ground infrastructure is required. On the other hand, en-This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE). This publication reflects the authors' views only. The European Commission is not responsible for any use that may be made of the information it contains.

show abstract

“…The motion of multiple UAVs around dynamic targets is coordinated through a centralized master-slave approach. A greedy framework for multi-UAV camera coordination is proposed in [17]. A decentralized planner computes UAV trajectories considering smoothness, shot diversity, collision avoidance, and mutual visibility.…”

Section: A Related Workmentioning

confidence: 99%

“…The baseline approach generates straight trajectories, whereas our method results in orbital trajectories, which have been used in the cinematography literature to produce more pleasant videos. For instance, [16], [17], [33] apply the arcball principle [34] to create a spherical surface around the target for aesthetic camera motion. We can also see in Fig.…”

Section: B Simulation -Cinematography Trajectoriesmentioning

confidence: 99%

Autonomous Aerial Filming With Distributed Lighting by a Team of Unmanned Aerial Vehicles

Krátký

Alcántara

Capitán

et al. 2021

IEEE Robot. Autom. Lett.

View full text Add to dashboard Cite

This paper describes a method for autonomous aerial cinematography with distributed lighting by a team of unmanned aerial vehicles (UAVs). Although camera-carrying multirotor helicopters have become commonplace in cinematography, their usage is limited to scenarios with sufficient natural light or of lighting provided by static artificial lights. We propose to use a formation of unmanned aerial vehicles as a tool for filming a target under illumination from various directions, which is one of the fundamental techniques of traditional cinematography. We decompose the multi-UAV trajectory optimization problem to tackle non-linear cinematographic aspects and obstacle avoidance at separate stages, which allows us to re-plan in real time and react to changes in dynamic environments. The performance of our method has been evaluated in realistic simulation scenarios and field experiments, where we show how it increases the quality of the shots and that it is capable of planning safe trajectories even in cluttered environments.

show abstract

Do You See What I See? Coordinating Multiple Aerial Cameras for Robot Cinematography

Abstract: Fig. 1: Our framework uses a set of objectives for multi-UAV cinematography to coordinate all cameras trajectories with a fast centralized viewpoint planner coupled with a decentralized trajectory optimization algorithm. We deploy the system in real-world settings.

Cited by 13 publications

References 38 publications

Swarm of micro flying robots in the wild

Swarm of micro flying robots in the wild

A multiple-UAV architecture for autonomous media production

Autonomous Aerial Filming With Distributed Lighting by a Team of Unmanned Aerial Vehicles

Contact Info

Product

Resources

About