A Multisensory Tactile System for Robotic Hands to Recognize Objects

Abstract

Multisensory tactile systems play an important role in enhancing robot intelligence. A competent robotic tactile system needs to be simple in structure and easily operated, especially with multiple sensations, and have good coordinate ability like human skin. A novel multisensory tactile system for humanoid robotic hands is proposed, allowing the hand to identify objects by grasping and manipulating them. Robotic multifunction sensors based on skin‐inspired thermosensation and structured with micro platinum ribbons partially covered with piezo‐thermic silver‐nanoparticle‐doped porous polydimethylsiloxane membrane simultaneously and independently detect contact pressure, local ambient temperature, and thermal conductivity and temperature of an object. Multiple tactile information which is obtained by the robotic sensors is fused comprehensively based on neural network classification to identify diverse objects in uncertain and dynamic gripping with an object recognition accuracy of 95%. This multisensory system enables robotic hand to better interact with its environment, enhances robotic intelligence, and makes various complex tasks feasible for robots, such as sorting material or rescuing from fire or other disasters.

A comparative UPLC‐Q‐Orbitrap‐MS untargeted metabolomics investigation of different parts of Clausena lansium (Lour.) Skeels

“…Flavonoids were proved to be powerful radical quenchers in various systems. (Zhang et al., 2018) Most of the flavonoids were firstly identified in C. lansium such as Procyanidin B2, malvidin 3‐glucoside, isoquercitrin, astragalin, quercetin 3‐arabinoside, taxifolin, sakuranetin, etc.. Procyanidin B2, and malvidin 3‐glucoside mainly derived from grape seed and red wine were proved to exert protective effects against cardiovascular diseases (Bub, Watzl, Heeb, Rechkemmer, & Briviba, 2001; Li & Zhu, 2019). Isoquercitrin (quercetin‐3‐O‐β‐d‐glucopyranoside) and astragalin commonly found in traditional herbs and medicinal plants were reported to have anti‐inflammatory effects (Rogerio et al., 2007; Soromou et al., 2012; Valentova, Vrba, Bancirova, Ulrichova, & Kren, 2014).…”

Wearable Triboelectric Sensors Enabled Gait Analysis and Waist Motion Capture for IoT‐Based Smart Healthcare Applications

“…Among the machine learning methods, artificial neural network (ANN) is a quite effective approach to solve complex classification problems with good robustness and scalability, and it has been proposed to be applied in analyzing tactile signals for high‐accuracy object recognition. [ 85 , 86 ] Thus, the smart insole combined with ANN‐based predicting model provides an alternative solution for patient recognition to fulfill the scenarios involving information identification, avoiding the risks of privacy disclosure.…”

Material Recognition Sensor Array by Electrostatic Induction and Triboelectric Effects

“…As far as we know, except for some reports using the physical-properties of materials, such as temperature, texture, robustness, and piezoelectric properties, most material recognition reported is actual object recognition, and it needs a large amount of image data about the positions, shapes and colors of the objects. [8][9][10][11][12][13][14][15][16] Triboelectric effect was successfully used in triboelectric nanogenerators (TENG) by Wang et al [17] and, ever since then, many valuable researches have been done in improving the energy transfer efficiency, pressure, and distance sensors, selfpowered system etc. [18][19][20][21][22][23] Moreover, theoretical model serves as guidance that triboelectric output performance can be affected by several factors such as film thickness, area size, dielectric properties, and gap distance.…”