Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial intelligence. Another subfield of machine learning named reinforcement learning, tries to find an optimal behavior strategy through interactions with the environment. Combining deep learning and reinforcement learning permits resolving critical issues relative to the dimensionality and scalability of data in tasks with sparse reward signals, such as robotic manipulation and control tasks, that neither method permits resolving when applied on its own. In this paper, we present recent significant progress of deep reinforcement learning algorithms, which try to tackle the problems for the application in the domain of robotic manipulation control, such as sample efficiency and generalization. Despite these continuous improvements, currently, the challenges of learning robust and versatile manipulation skills for robots with deep reinforcement learning are still far from being resolved for real-world applications.

This concept paper draws from our previous research on individual grip force data collected from biosensors placed on specific anatomical locations in the dominant and non-dominant hand of operators performing a robot-assisted precision grip task for minimally invasive endoscopic surgery. The specificity of the robotic system on the one hand, and that of the 2D image-guided task performed in a real-world 3D space on the other, constrain the individual hand and finger movements during task performance in a unique way. Our previous work showed task-specific characteristics of operator expertise in terms of specific grip force profiles, which we were able to detect in thousands of highly variable individual data. This concept paper is focused on two complementary data analysis strategies that allow achieving such a goal. In contrast with other sensor data analysis strategies aimed at minimizing variance in the data, it is necessary to decipher the meaning of intra- and inter-individual variance in the sensor data on the basis of appropriate statistical analyses, as shown in the first part of this paper. Then, it is explained how the computation of individual spatio-temporal grip force profiles allows detecting expertise-specific differences between individual users. It is concluded that both analytic strategies are complementary and enable drawing meaning from thousands of biosensor data reflecting human performance measures while fully taking into account their considerable inter- and intra-individual variability.

Aerial drone technology is currently being investigated worldwide for the delivery of blood components. Although it has been demonstrated to be safe, the delivered medical substances still need to be analyzed at the end of the flight mission to assess the level of haemolysis and pH prior to the use in a patient. This process can last up to 30 min and prevent the time saved using drone delivery. Our study aims to integrating an innovative sensor for the haemolysis and pH detection into the Smart Capsule, an already demonstrated technology capable of managing transfusion transport through drones. In the proposed scenario, the haemolysis is evaluated optically by a minilysis device using LED–photodetector combination. The preliminary validation has been demonstrated for both the thermal stability of the Smart Capsule and the haemolysis detection of the minilysis device prototype. Firstly, the onboard temperature test has shown that the delivery system is capable of maintaining proper temperature, even though the samples have been manipulated to reach a higher temperature before inserting into the Smart Capsule. Then, in the laboratory haemolysis test, the trend of linear regression between the outputs from the spectrophotometer and the minilysis prototype confirmed the concept design of the minilysis device.

This paper proposes a device of sensing that could be integrated into the instruments of any surgical robot. Despite advances in robot-assisted laparoscopic surgery, the tools currently supplied to surgical robots have limited functions, due to the absence of sensorization. With this motivation, we present a preliminary work based on the design, development, and early stages of experimentation with smart and multifunctional devices of sensing for surgical tools. The proposed device of sensing has a proximity sensor, colorimetric sensor, and BLE connection for different surgical instruments to connect to each other. The proximity feedback allows the surgeon to know the distance of the instrument from a particular tissue, to operate in conditions of greater safety. With the colorimetric feedback, on the other hand, we intend to proceed to the identification of specific tissue areas with characteristics that are not typical of the physiological tissue. The results show that the device is promising and can be further developed for multiple clinical needs in robotic procedures. This system can effectively increase the functionality of surgical instruments by overcoming the sensing limitations introduced by using robots in laparoscopic surgery.