Tactile sensing with gesture-controlled collaborative robot

Sorgini, Francesca; Farulla, Giuseppe Airò; Lukić, Nikola; Danilov, Ivan; Roveda, Loris; Milivojevic, Milos; Pulikottil, Terrin; Carrozza, Maria Chiara; Prinetto, P.; Tolio, Tullio; Oddo, Calogero Maria; Petrović, Petar B.; Bojović, Božica

doi:10.1109/metroind4.0iot48571.2020.9138183

Cited by 7 publications

(3 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…From the perspective of interactive experience, this paper has some shortcomings; for example, users cannot feel the grip force. Sorgini [52] controlled a robot interface via vision-based marker-less technology for hand tracking, with vibrotactile feedback delivered to the user's hand. This way of adding vibratory feedback may improve interaction adaptability to a certain extent.…”

Section: Experimental Time Consumptionmentioning

confidence: 99%

Human–Robot Collaborative Assembly Based on Eye-Hand and a Finite State Machine in a Virtual Environment

Zhao

Chen

et al. 2021

Applied Sciences

View full text Add to dashboard Cite

With the development of the global economy, the demand for manufacturing is increasing. Accordingly, human–robot collaborative assembly has become a research hotspot. This paper aims to solve the efficiency problems inherent in traditional human-machine collaboration. Based on eye–hand and finite state machines, a collaborative assembly method is proposed. The method determines the human’s intention by collecting posture and eye data, which can control a robot to grasp an object, move it, and perform co-assembly. The robot’s automatic path planning is based on a probabilistic roadmap planner. Virtual reality tests show that the proposed method is more efficient than traditional methods.

show abstract

Section: Experimental Time Consumptionmentioning

confidence: 99%

Human–Robot Collaborative Assembly Based on Eye-Hand and a Finite State Machine in a Virtual Environment

Zhao

Chen

et al. 2021

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…The current and hot issues are teleoperation and telepresence in research. Many systems used various grounded device like space balls or joystick to control the operation of the robotic arm [5]- [6], some uses sensors [7] whereas some systems imply artificial intelligence-trained models to mimic the operator's arm positions [8], different approaches have been used for the realization of force feedback using SMA clutch mechanism on distal finger segments [9] and through spikes generated through a neural spiking model on receiving force signal via load cells mounted on the robotic end effector [10]. A power assist system is a human-robot cooperation technology and is mostly used in the rehabilitation and healthcare of disabled or older people [11].…”

Section: Introductionmentioning

confidence: 99%

Design and Implementation of Force Sensation and Feedback Systems for Telepresence Robotic Arm

Nisa

Samo

Nizamani

et al. 2022

Journal of Robotics and Control

View full text Add to dashboard Cite

Humans put their own lives aside to save other human’s life and perform risky and dangerous activities. The risk can be reduced by using new technologies. This research study focuses on telepresence and teleoperation systems with motion and force control systems that replace humans in hazardous workspaces. In telepresence, the system helps humans to visualize the environment in real-time. In teleoperation, the system provides sensation to assist human beings in performing out-of-reach and dangerous operations safely as in real, providing a shadow hand to the operator. In this study, a system is developed that consists of a slave robotic arm and a master wearable device with bidirectional communication between the robotic arm and operator (master wearable device). It also presents a gesture-controlled robotic arm that uses sensors to read and translate human arm movements as commands. The slave robotic arm, senses applied force on an object and a master wearable device develops the force according to sensed force, in a result operator senses/feels the same object in the control room at distance. The slave robotic arm also mimics the operator arm to reach the proper position of an object. Several experiments were conducted with untrained personnel and satisfactory results were yielded, which showed that the motion and force replication is 90-95% accurate.

show abstract

“…conducted a user study to understand the impact of robot attributes on team dynamics and collaboration performance, finding that vocalizing robot intentions can decrease team performance and perceived safety.Ionescu & Schlud (2021) [29] found that voice activated cobot programming is more efficient than typing and other programming techniques. These papers collectively contribute to the development of humanrobot vocal communication systems and highlight the challenges and opportunities in this field.•Tactile communications: The incorporation of tactile feedback mechanisms enhances the haptic dimension of human-cobot collaboration[30] (Sorgini et al 2020). Tactile interfaces, such as force…”

mentioning

confidence: 99%

Vocal Communication between Cobots and Humans to Enhance Productivity and Safety: Review and Discussion

Cohen,

Rozenes,

Faccio

2024

Preprint

View full text Add to dashboard Cite

This paper explores strategies for fostering efficient vocal communication and collaboration between human workers and collaborative robots (cobots) in assembly processes. Vocal communication enables division of attention of the worker, as it frees the visual attention, and the worker’s hands, dedicated to the task at hand. Speech generation and speech recognition are pre-requisites for effective vocal communication. The study focuses on cobot assistive tasks, where the human is in charge of the work and performs the main tasks while the cobot assists the worker in various peripheral jobs, such as bringing tools, parts, or materials, and returning them, or disposing them; or screwing or packaging the products. A nuanced understanding is necessary for understanding how human-robot interactions can be optimized to enhance overall productivity and safety. Through a comprehensive review of relevant literature and empirical studies, this manuscript identifies key factors influencing successful vocal communication, and proposes practical strategies for implementation.

show abstract

Tactile sensing with gesture-controlled collaborative robot

Cited by 7 publications

References 20 publications

Human–Robot Collaborative Assembly Based on Eye-Hand and a Finite State Machine in a Virtual Environment

Human–Robot Collaborative Assembly Based on Eye-Hand and a Finite State Machine in a Virtual Environment

Design and Implementation of Force Sensation and Feedback Systems for Telepresence Robotic Arm

Vocal Communication between Cobots and Humans to Enhance Productivity and Safety: Review and Discussion

Contact Info

Product

Resources

About