Recently, pre-trained language representation models such as bidirectional encoder representations from transformers (BERT) have been performing well in commonsense question answering (CSQA). However, there is a problem that the models do not directly use explicit information of knowledge sources existing outside. To augment this, additional methods such as knowledge-aware graph network (KagNet) and multi-hop graph relation network (MHGRN) have been proposed. In this study, we propose to use the latest pre-trained language model a lite bidirectional encoder representations from transformers (ALBERT) with knowledge graph information extraction technique. We also propose to applying the novel method, schema graph expansion to recent language models. Then, we analyze the effect of applying knowledge graph-based knowledge extraction techniques to recent pre-trained language models and confirm that schema graph expansion is effective in some extent. Furthermore, we show that our proposed model can achieve better performance than existing KagNet and MHGRN models in CommonsenseQA dataset.

No abstract

Recently, the development of the Internet of Things (IoT) has enabled continuous and personal electrocardiogram (ECG) monitoring. In the ECG monitoring system, classification plays an important role because it can select useful data (i.e., reduce the size of the dataset) and identify abnormal data that can be used to detect the clinical diagnosis and guide further treatment. Since the classification requires computing capability, the ECG data are usually delivered to the gateway or the server where the classification is performed based on its computing resource. However, real-time ECG data transmission continuously consumes battery and network resources, which are expensive and limited. To mitigate this problem, this paper proposes a tiny machine learning (TinyML)-based classification (i.e., TinyCES), where the ECG monitoring device performs the classification by itself based on the machine-learning model, which can reduce the memory and the network resource usages for the classification. To demonstrate the feasibility, after we configure the convolutional neural networks (CNN)-based model using ECG data from the Massachusetts Institute of Technology (MIT)-Beth Israel Hospital (BIH) arrhythmia and the Physikalisch Technische Bundesanstalt (PTB) diagnostic ECG databases, TinyCES is validated using the TinyMLsupported Arduino prototype. The performance results show that TinyCES can have an approximately 97% detection ratio, which means that it has great potential to be a lightweight and resource-efficient ECG monitoring system.

Vehicular caching (VC) in electro‐mobility networks has become promising for supporting the needs of low end‐to‐end service delays and reducing the load of networks (i.e. edge caching [EC]) for content delivery service. However, since VCs are available only when they are in the vicinity of the user, intermittent connectivity should be considered. In this paper, the opportunistic offloading scheme for content delivery service is proposed, and a decision is made regarding whether to use VC or EC for the content delivery service. In the proposed scheme, when VC is not available, the user determines whether to choose VC or EC for the content download. If VC is chosen, the user delays the content download to increase the VC utilization according to the expectation of VC contacts. This results in the delayed service completion but can reduce the EC load (i.e. offloading gain). If EC is chosen, the user can download the content without any delay or service interruption. To find the optimal policy, this paper formulates a Markov decision process (MDP) problem and uses the value iteration algorithm to solve the problem. The evaluation results show that the proposed scheme outperforms the comparison schemes based on the expected reward.

No abstract