A Framework for Smart Home System with Voice Control Using NLP Methods

Abstract

The proliferation of information technologies and the emergence of ubiquitous computing have quickly transformed electronic devices from isolated islands of data and control into interconnected parts of intelligent systems. These network-based systems have advanced features, including Internet of Things (IoT) sensors and actuators, multiple connectivity options and multimodal user interfaces, and they also enable remote monitoring and management. In order to develop a human machine interface of smart home systems with speech recognition, we propose a new IoT-fog-cloud framework using natural language processing (NLP) methods. The new methodology adds utterance to command transformation to the existing cloud-based speech-to-text and text-to-speech services. This approach is flexible and can be easily adapted for different types of automation systems and consumer electronics as well as to almost every non-tonal language not currently supported by online platforms for intent detection and classification. The proposed framework has been employed in the development of prototypes of voice user interface extension of existing smart security system via new service for speech intent recognition. Tests on the system were carried out and the obtained results show the effectiveness of the new voice communication option. The speech-based interface is reliable; it facilitates customers and improves their experience with smart home devices.

Activation Function Dynamic Averaging as a Technique for Nonlinear 2D Data Denoising in Distributed Acoustic Sensors

“…After training the system, this will not require serious additional computing resources. We expect that the proposed combined application of algorithms and artificial intelligence methods will expand the possibilities surrounding distributed acoustic sensor utilization for the registration of voice commands [52][53][54] and their origin localization in smart home systems, smart production [55][56][57], and other Internet of Things applications [58].…”

Detection and Recognition of Voice Commands by a Distributed Acoustic Sensor Based on Phase-Sensitive OTDR in the Smart Home Concept

“…The key feature of the sensors in such intelligent systems is their ability to acquire information without distraction from daily activities. One of the most common and simplest control methods from the point of view of human physiology is a voice command [6,7]. However, using an example of a smart home, we can easily see that not all IoT devices have voice input devices (microphones)-for example, refrigerators and microwave ovens are typically not controlled by voice.…”

Design and Implementation of a Framework for Smart Home Automation Based on Cellular IoT, MQTT, and Serverless Functions

“…Lambda also comes with extensive integration with Amazon Alexa [10], the voice assistant on Amazon Echo. Voice interfaces are seeing a wider use in different application fields, from voice assistants to home automation, as they constitute a more natural and intuitive interface to interact with smart objects and environments, as well as improving accessibility [11].…”

“…Different recent works explored the potentiality of integrating Amazon Alexa or, more generally, voice services into the smart environment to enable interactive and accessible interfaces. Iliev et al [11] proposes a distributed framework for smart homes that uses natural language processing (NLP) to develop a human/smart environment interface. Their solution introduces a fog node for the deployment of intelligent user interface (IUI) software to reduce the voice interface response delay and to decrease bandwidth load.…”