HiMessage: An Interactive Voice Mail System with the Humanoid Robot Pepper

Barra, Paola; Bisogni, Carmen; Rapuano, Antonio; Abate, Andrea F.; Iovane, Gerardo

doi:10.1109/dasc/picom/cbdcom/cyberscitech.2019.00123

Cited by 10 publications

(4 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The prototype of the proposed framework, implemented using the Pepper robot as the hardware base, has proven to be successful, while the customers report to have the impression of actually talking with the robot, despite the fact that the robot is admittedly only a sophisticated interface for the framework to present selected data that come from numerous smart sensors and information systems. The User Experience (UX) of interaction with robot is in part a consequence of its good (apparently sufficient) capability of efficient man-machine interaction-not only by using voice (natural language) [23] and graphical interface, but also by using nonverbal communication, that is, gestures, in various combinations and intensities, depending on the purpose of the message generated by main AI core module.…”

Section: Resultsmentioning

confidence: 99%

Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors

Podpora

Gardecki

Beniak

et al. 2020

Sensors

View full text Add to dashboard Cite

This paper presents a more detailed concept of Human-Robot Interaction systems architecture. One of the main differences between the proposed architecture and other ones is the methodology of information acquisition regarding the robot's interlocutor. In order to obtain as much information as possible before the actual interaction took place, a custom Internet-of-Things-based sensor subsystems connected to Smart Infrastructure was designed and implemented, in order to support the interlocutor identification and acquisition of initial interaction parameters. The Artificial Intelligence interaction framework of the developed robotic system (including humanoid Pepper with its sensors and actuators, additional local, remote and cloud computing services) is being extended with the use of custom external subsystems for additional knowledge acquisition: device-based human identification, visual identification and audio-based interlocutor localization subsystems. These subsystems were deeply introduced and evaluated in this paper, presenting the benefits of integrating them into the robotic interaction system. In this paper a more detailed analysis of one of the external subsystems-Bluetooth Human Identification Smart Subsystem-was also included. The idea, use case, and a prototype, integration of elements of Smart Infrastructure systems and the prototype implementation were performed in a small front office of the Weegree company as a decent test-bed application area.The days, when simply having a robot was impressive, are gone. The technology should be more than just presenting content. It should be truly interactive. The authors of this work evaluated methods for the purpose of measurement and influencing the Human-Robot interaction User Experience, (see Reference [1]), concluding that the robot's interaction is perceived as more natural if the robot is able to personalize its communication content towards a particular interlocutor. It became clear, that the system should be able to get as much information as possible during and before the conversation takes place [2]. One of the key aspects in a healthy conversation is emotional state recognition. All the improvements of the robots presented in this paper are aiming for natural, real integration with human customers with the implementation of Artificial Intelligence [3,4].The authors of this work have indicated extending the robot's capabilities by adding additional external wireless sensors in Reference [2], however without Smart Infrastructure. Implementation of a remote PID (Passive Infrared Detector) sensor in order to get a signal "someone is coming" seemed to be enough at that stage.In this paper an extended approach is being presented, introducing Human Identification Smart Subsystems (HISS)-a set of external sensors, which enable us to obtain much more valuable information, resulting from the communication with the Smart Infrastructure [5] or databases of the customer. The idea presented in this paper has been successfully verified and implemented and the con...

show abstract

Section: Resultsmentioning

confidence: 99%

Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors

Podpora

Gardecki

Beniak

et al. 2020

Sensors

View full text Add to dashboard Cite

show abstract

“…Facial recognition techniques can help the robot to verify the identity of whoever is in its visual range [47], capturing his/her presence. Thanks to facial recognition and word recognition, Pepper can also be a reliable interactive voice mail system [2]. In an uncontrolled context, the quality of the acquired image can be influenced by several factors as in the cases of occlusions and alignment with the pose of a subject.…”

Section: A Methods Built On Peppermentioning

confidence: 99%

“…Pepper is a human-shaped social robot, manufactured by SoftBank Robotics Corp. and Aldebaran Robotics SAS; its successor is NAO, a humanoid robot from the same company [6]. Both devices have NAOqi operating system 1 but Pepper can be managed also through the Robot Operating System (ROS), 2 which is the main middle-ware in robotics. Pepper is designed to engage people and interact with them, being able to understand the most basic human emotions and react accordingly [5].…”

Section: A the Humanoid Robot Peppermentioning

confidence: 99%

See 1 more Smart Citation

Contextual Trust Model With a Humanoid Robot Defense for Attacks to Smart Eco-Systems

et al. 2020

Self Cite

View full text Add to dashboard Cite

Pepper is a humanoid robot that just embeds the few computational resources for controlling its sensors and actuators, and is not capable of handling big amounts of data or performing in parallel complicate tasks. Aiming at enriching its functionalities and its interaction with the environment, the robot has been put in communication with a plethora of satellite smart objects and services ranging from simple environmental sensors, up to deep learning enhanced smart cameras. The addition of biometric, emotional, social, machine learning and other capabilities to Pepper, while enabling advanced functionalities and additional instruments for controlling users and the environment, raises security and, obviously, privacy concerns. The robot itself, its interaction with the environment and every weakness exposed by the smart objects involved in its ecosystem, may represent an exploit point for attacking the smart home and threaten security and privacy. Aiming at preventing attacks and strengthen security, each action with the system is evaluated against the entire context, as detected by the entire eco-system of smart-objects. This paper describes and analyses the experience and how the semantic trust model adopted mitigates the effects of weaknesses and the risks related to smart home cyber-attacks.INDEX TERMS Social robots, human-robot interaction, Internet of Things, ontologies, trust model, Pepper.

show abstract

Enhancing Assistive Technology with Biomimicry and Social Robots

Gandhi

Goyal

2021

Hybrid Intelligent Systems

View full text Add to dashboard Cite

HiMessage: An Interactive Voice Mail System with the Humanoid Robot Pepper

Cited by 10 publications

References 14 publications

Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors

Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors

Contextual Trust Model With a Humanoid Robot Defense for Attacks to Smart Eco-Systems

Enhancing Assistive Technology with Biomimicry and Social Robots

Contact Info

Product

Resources

About