Target Recognition and Localization of Mobile Robot with Monocular PTZ Camera

Wang, Hongxing; Li, Ruifeng; Gao, Yanbin; Cao, Chuqing; Liu, Ge; Xie, Xiaoyao

doi:10.1155/2019/8789725

Cited by 5 publications

(3 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To compensate for these limitations, many broadcasting stations or research teams are developing and using automatic camera shooting systems such as camera system, calibration, pan, tilt, and zoom control methods [10][11][12][13][14][15]. In particular, for reality entertainment and sports broadcasts such as the Olympics, cameras are attached to robots or control assistance systems [16,17] capable of pan, tilt, and zoom to automatically take videos, thus replacing camera persons [18][19][20][21][22][23][24]. However, this shooting technology simply tracks a person or controls a camera using a remote control device such as a joystick, and there is a limit to performing or broadcasting using only this technology [25,26].…”

Section: Introductionmentioning

confidence: 99%

Development for Multisensor and Virtual Simulator–Based Automatic Broadcast Shooting System

Lee

Lim

Kim

2022

International Journal of Digital Multimedia Broadcasting

View full text Add to dashboard Cite

To solve the limitations of complexity and repeatability of existing broadcast filming systems, a new broadcast filming system was developed. In particular, for Korean music broadcasts, the shooting sequence is stage and lighting installation, rehearsal, lighting effect production, and main shooting; however, this sequence is complex and involves multiple people. We developed an automatic shooting system that can produce the same effect as the sequence with a minimum number of people as the era of un-tact has emerged because of COVID-19. The developed system comprises a simulator. After developing a stage using the simulator, during rehearsal, dancers’ movements are acquired using UWB and two-dimensional (2D) LiDAR sensors. By inserting acquired movement data in the developed stage, a camera effect is produced using a virtual camera installed in the developed simulator. The camera effect comprises pan, tilt, and zoom, and a camera director creates lightning effects while evaluating the movements of virtual dancers on the virtual stage. In this study, four cameras were used, three of which were used for camera pan, tilt, and zoom control, and the fourth was used as a fixed camera for a full shot. Video shooting is performed according to the pan, tilt, and zoom values of the three cameras and switcher data. Only the video of dancers recorded during rehearsal and that produced by the lighting director via the existing broadcast filming process is overlapped in the developed simulator to assess lighting effects. The lighting director assesses the overlapping video and then corrects parts that require to be corrected or emphasized. The abovementioned method produced better lighting effects optimized for music and choreography compared to existing lighting effect production methods. Finally, the performance and lighting effects of the developed simulator and system were confirmed by shooting using K-pop using the pan, tilt, and zoom control plan, switcher sequence, and lighting effects of the selected camera.

show abstract

Section: Introductionmentioning

confidence: 99%

Development for Multisensor and Virtual Simulator–Based Automatic Broadcast Shooting System

Lee

Lim

Kim

2022

International Journal of Digital Multimedia Broadcasting

View full text Add to dashboard Cite

show abstract

“…e fruit industry, as a labour-intensive industry, has a large demand for labour and low work efficiency. e automation and mechanization industry chain needs upgrade urgently [1]. With the rapid development of the artificial intelligence, the fruit recognition and fruit picking have always being studied [2].…”

Section: Introductionmentioning

confidence: 99%

Multiview Machine Vision Research of Fruits Boxes Handling Robot Based on the Improved 2D Kernel Principal Component Analysis Network

Yang

et al. 2021

Journal of Robotics

View full text Add to dashboard Cite

In order to better realize the orchard intelligent mechanization and reduce the labour intensity of workers, the study of intelligent fruit boxes handling robot is necessary. The first condition to realize intelligence is the fruit boxes recognition, which is the research content of this paper. The method of multiview two-dimensional (2D) recognition was adopted. A multiview dataset for fruits boxes was built. For the sake of the structure of the original image, the model of binary multiview 2D kernel principal component analysis network (BM2DKPCANet) was established to reduce the data redundancy and increase the correlation between the views. The method of multiview recognition for the fruits boxes was proposed combining BM2DKPCANet with the support vector machine (SVM) classifier. The performance was verified by comparing with principal component analysis network (PCANet), 2D principal component analysis network (2DPCANet), kernel principal component analysis network (KPCANet), and binary multiview kernel principal component analysis network (BMKPCANet) in terms of recognition rate and time consumption. The experimental results show that the recognition rate of the method is 11.84% higher than the mean value of PCANet though it needs more time. Compared with the mean value of KPCANet, the recognition rate exceeded 2.485%, and the time saved was 24.5%. The model can meet the requirements of fruits boxes handling robot.

show abstract

“…At the same time, when it is on the ground with many obstacles, the biped walking structure of humanoid robot can still walk and climb stairs and can arrive smoothly. In the market, there are many kinds of robots, such as industrial robots (Wang et al , 2019). Compared with industrial robots, the biggest advantage of humanoid robots lies in the active space and working space, which is more flexible.…”

Section: Introductionmentioning

confidence: 99%

Research on target recognition and mobile job control of humanoid robot based on KM34Z256 for industrial applications

Wang

Sharma

2021

IJICC

View full text Add to dashboard Cite

PurposeHumanoid robot has similar shape and action characteristics as humans, and it can complete some basic tasks instead of humans without changing the human environment, which makes humanoid robot become the best structure and help form for robot to provide services for human beings.Design/methodology/approachThe mobile operation control of humanoid robot is generated by the walking movement of humanoid robot's feet, and the robot's hand and arm complete grasping and other operations together.FindingsOn the basis of humanoid robot, the integrated system of software and hardware based on the KM34Z256 humanoid robot is described first, and a series of kinematics discussion on its mobile operation is carried out.Originality/valueThe research based on this project shows that the target recognition and positioning method is not only accurate and of high energy but also can realize the mobile operation of humanoid robot.

show abstract

Target Recognition and Localization of Mobile Robot with Monocular PTZ Camera

Cited by 5 publications

References 4 publications

Development for Multisensor and Virtual Simulator–Based Automatic Broadcast Shooting System

Development for Multisensor and Virtual Simulator–Based Automatic Broadcast Shooting System

Multiview Machine Vision Research of Fruits Boxes Handling Robot Based on the Improved 2D Kernel Principal Component Analysis Network

Research on target recognition and mobile job control of humanoid robot based on KM34Z256 for industrial applications

Contact Info

Product

Resources

About