No abstract

Distributed artificial intelligence (AI) is becoming an efficient approach to fulfill the high and diverse requirements for future vehicular networks. However, distributed intelligence tasks generated by vehicles often require diverse resources. A customized resource provision scheme is required to improve the utilization of multi-dimensional resources. In this work, a slice selection-based online offloading (SSOO) algorithm is proposed for distributed intelligence in future vehicular networks. First, the response time and energy consumption are reduced for processing tasks locally on the vehicles. Then, the offloading overheads, including latency and energy consumption, are calculated by considering the available resource amount, wireless channel states and vehicle conditions. The slice selection results is obtained by the deep reinforcement learning (DRL)-based method. Based on the selection solution, resource allocation results are achieved by KKT conditions and bisection method. Finally, the experimental results depict that the proposed SSOO algorithm outperforms other comparing algorithms in terms of energy consumption and task completion rate.

Continual learning is an intellectual ability of artificial agents to learn new streaming labels from sequential data. The main impediment to continual learning is catastrophic forgetting, a severe performance degradation on previously learned tasks. Although simply replaying all previous data or continuously adding the model parameters could alleviate the issue, it is impractical in real-world applications due to the limited available resources. Inspired by the mechanism of the human brain to deepen its past impression, we propose a novel framework, Deep Retrieval and Imagination (DRI), which consists of two components: 1) an embedding network that constructs a unified embedding space without adding model parameters on the arrival of new tasks; and 2) a generative model to produce additional (imaginary) data based on the limited memory. By retrieving the past experiences and corresponding imaginary data, DRI distills knowledge and rebalances the embedding space to further mitigate forgetting. Theoretical analysis demonstrates that DRI can reduce the loss approximation error and improve the robustness through retrieval and imagination, bringing better generalizability to the network. Extensive experiments show that DRI performs significantly better than the existing state-of-the-art continual learning methods and effectively alleviates catastrophic forgetting.

It is desirable to include more controllable attributes to enhance the diversity of generated responses in open-domain dialogue systems. However, existing methods can generate responses with only one controllable attribute or lack a flexible way to generate them with multiple controllable attributes. In this paper, we propose a Progressively trained Hierarchical Encoder-Decoder (PHED) to tackle this task. More specifically, PHED deploys Conditional Variational AutoEncoder (CVAE) on Transformer to include one aspect of attributes at one stage. A vital characteristic of the CVAE is to separate the latent variables at each stage into two types: a global variable capturing the common semantic features and a specific variable absorbing the attribute information at that stage. PHED then couples the CVAE latent variables with the Transformer encoder and is trained by minimizing a newly derived ELBO and controlled losses to produce the next stage's input and produce responses as required. Finally, we conduct extensive evaluations to show that PHED significantly outperforms the state-of-the-art neural generation models and produces more diverse responses as expected.

No abstract