No abstract

Coal ® res in the north of China have already resulted in serious problems, including huge losses in coal resources, air pollution and so on. Thermal infrared images by Landsat Thematic Mapper (TM) can be used to detect some thermal anomalies. However, an initial necessity is to reduce the eVect of solar radiation on TM thermal infrared images. In this paper, a neural network is used to set up a mathematical model of ground temperature for the ® rst time. After the neural network completes training, we can use it to calculate the ground temperature caused by solar radiation. Thus, the result can be used to reduce the eVect of solar radiation on TM thermal infrared images, and extract the thermal anomalies caused by coal ® res.

No abstract

No abstract

Although deep pre-trained language models have shown promising benefit in a large set of industrial scenarios, including Click-Through-Rate (CTR) prediction, how to integrate pre-trained language models that handle only textual signals into a prediction pipeline with non-textual features is challenging.Up to now, two directions have been explored to integrate multimodal inputs in fine-tuning of pre-trained language models. One consists of fusing the outcome of language models and non-textual features through an aggregation layer, resulting into ensemble framework, where the cross-information between textual and nontextual inputs are learned only in the aggregation layer. The second one consists of splitting and transforming non-textual features into fine-grained tokens that are fed, along with textual tokens, directly into the transformer layers of language models. However, by adding additional tokens, this approach increases the complexity of the learning and inference.We propose in this paper, a novel framework, BERT4CTR, that addresses these limitations. The new framework leverages Uni-Attention mechanism to benefit from the interactions between non-textual and textual features, while maintaining low training and inference time-costs, through a dimensionality reduction. We demonstrate through comprehensive experiments on both public and commercial data that BERT4CTR outperforms significantly the state-of-the-art approaches to handle multi-modal inputs and is applicable to CTR prediction. In comparison with ensemble framework, BERT4CTR brings more than 0.4% AUC gain on both tested data sets with only 7% increase on latency.