Towards virtualized welding: Visualization and monitoring of remote welding

Fu, Bo; Seidelman, Will; Liu, Yukang; Kent, Travis; Carswell, C. Melody; Zhang, Yuming; Yang, Ruigang

doi:10.1109/icme.2014.6890297

Cited by 7 publications

(8 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The debate on the benefits and limitations of such alternative display options is complex [4] and is beyond the scope of this work. A full technical overview and results from an initial user evaluation are presented in [3]. …”

Section: Hybrid-reality Display Overviewmentioning

confidence: 99%

“…Recently, Fu and colleagues [3] have proposed a new hybrid-reality display for weld monitoring. We are currently in the process of a multi-study investigation of the possible performance benefits this type of display may provide, and are attempting to develop new visualization methods for use with the display created through investigation of users' cognitive requirements.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

User centered design of a hybrid-reality display for weld monitoring

Seidelman

Lee

Carswell

et al. 2014

CHI '14 Extended Abstracts on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

show abstract

Section: Hybrid-reality Display Overviewmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

User centered design of a hybrid-reality display for weld monitoring

Seidelman

Lee

Carswell

et al. 2014

CHI '14 Extended Abstracts on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

show abstract

“…3 illustrates these calibrations in our system. For detail, please refer to [Fu et al 2014]. Calibration between motion sensor and TCP frame (S L , S T ) can be conducted based on solving a linear equation group of corresponding points.…”

Section: Technical Approachmentioning

confidence: 99%

“…On the visualization aspect, it contains a hybrid-reality display (HRD) system, which utilizes projectors to project a captured video image onto a 3D replica of the actual weld surface [Raskar et al 2001]. It provides a direct alignment between the frame of reference for the operator and that of the displayed image [Fu et al 2014]. On the human-robot interaction aspect, we developed and tested several interaction means, including the use of hand tracking and traditional control with a 3D mouse.…”

Section: Introductionmentioning

confidence: 99%

Virtualized welding

Liu

Zhang

et al. 2014

Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology

Self Cite

View full text Add to dashboard Cite

Figure 1: Virtualized Welding: Above: an illustration of our virtualized welding operation, in which existing welding robots are augmented with 3D sensors and video cameras to capture the working environment. The operator can monitor and control the welding process in an augmented display setup in which welding images are projected on a mock-up 3D surface. AbstractWe present a new mixed reality system that supports tele-operation of a welding robot. We create a 3D mockup of the welding pieces and use projector-based displays to visualize the welding process directly on the 3D display. Multi-cameras are used to capture both the welding environment and the operator's motion. The welder can therefore monitor and control the welding process as if the welding is on the mock-up, which provides proper spatial and 3D cues. We evaluated our system with a number of control tasks and the results shows the effectiveness of our system as compared to traditional alternatives.

show abstract

“…Welding has been used extensively in the maintenance of nuclear plants, the construction of underwater structures, and the repair of spacecraft in outer space [1]. In these hazardous situations in which human welders have no access, the judgment and intervention of the human operators are required [2].…”

Section: Introductionmentioning

confidence: 99%

Mixed Reality-Enhanced Intuitive Teleoperation with Hybrid Virtual Fixtures for Intelligent Robotic Welding

Chen

Zhou

et al. 2021

Applied Sciences

View full text Add to dashboard Cite

This paper presents an integrated scheme based on a mixed reality (MR) and haptic feedback approach for intuitive and immersive teleoperation of robotic welding systems. By incorporating MR technology, the user is fully immersed in a virtual operating space augmented by real-time visual feedback from the robot working space. The proposed robotic tele-welding system features imitative motion mapping from the user’s hand movements to the welding robot motions, and it enables the spatial velocity-based control of the robot tool center point (TCP). The proposed mixed reality virtual fixture (MRVF) integration approach implements hybrid haptic constraints to guide the operator’s hand movements following the conical guidance to effectively align the welding torch for welding and constrain the welding operation within a collision-free area. Onsite welding and tele-welding experiments identify the operational differences between professional and unskilled welders and demonstrate the effectiveness of the proposed MRVF tele-welding framework for novice welders. The MRVF-integrated visual/haptic tele-welding scheme reduced the torch alignment times by 56% and 60% compared to the MRnoVF and baseline cases, with minimized cognitive workload and optimal usability. The MRVF scheme effectively stabilized welders’ hand movements and eliminated undesirable collisions while generating smooth welds.

show abstract

Towards virtualized welding: Visualization and monitoring of remote welding

Cited by 7 publications

References 15 publications

User centered design of a hybrid-reality display for weld monitoring

User centered design of a hybrid-reality display for weld monitoring

Virtualized welding

Mixed Reality-Enhanced Intuitive Teleoperation with Hybrid Virtual Fixtures for Intelligent Robotic Welding

Contact Info

Product

Resources

About