The Department of Neurosurgery at Seoul National University: Past, Present, and Future

Abstract

Image-text retrieval is a task to search for the proper textual descriptions of the visual world and vice versa. One challenge of this task is the vulnerability to input image/text corruptions. Such corruptions are often unobserved during the training, and degrade the retrieval model's decision quality substantially. In this paper, we propose a novel image-text retrieval technique, referred to as robust visual semantic embedding (RVSE), which consists of novel image-based and text-based augmentation techniques called semantic-preserving augmentation for image (SPAug-I) and text (SPAug-T). Since SPAug-I and SPAug-T change the original data in a way that its semantic information is preserved, we enforce the feature extractors to generate semantic-aware embedding vectors regardless of the corruption, improving the model's robustness significantly. From extensive experiments using benchmark datasets, we show that RVSE outperforms conventional retrieval schemes in terms of image-text retrieval performance.1 Index Terms-image-text retrieval, data augmentation, robustness, image and text corruption INTRODUCTIONRecently, image-text retrieval, a task to find out images (sentence) that accurately describe a given sentence (image), has received special attention due to its wide range of applications such as image search, social networking service (SNS) hashtag/post generation, and semantic communication for Internet of Things (IoT), to name just a few [1,2,3,4,5]. Since it is in general very difficult to compare samples obtained from two different modalities (image and text), a projection of image and text to the common embedding space (a.k.a. visual semantic embedding (VSE) space) is required [1,2,6,7,8,9]. To generate the image and text embedding vectors, deep learning (DL)-based image and text feature extractors (i.e., ResNet and BERT) have been popularly used [10,11]. By comparing the obtained vectors, we can compute the similarity scores between available image-text pairs and then choose

Polyetheretherketone (PEEK) Surface Functionalization by Low-Energy Ion-Beam Irradiation under a Reactive O2 Environment and Its Effect on the PEEK/Copper Adhesives

“…The monotonic decrease in the contact angle can be ascribed to two separate causes: formation of hydrophilic functional groups and surface roughness change. Although it has been experimentally proven that ion-beam bombardment roughens a polymer surface, the roughness of PEEK film decreased with irradiation time, in contrast to the PTFE case. , The roughness of a PTFE film increases with irradiation; the water contact angle also increases. More details are given in the next section.…”

Nonwetting Process for Achieving Surface Functionalization of Chemically Stable Poly(tetrafluoroethylene)

“…The fact that the peel strength for the PTFE surface treated with only Ar + ion-beam irradiation increased with the irradiation time means that on the PTFE surface there were no weak points that did not fill with copper. Slowly evaporated copper could still fill the shallow roughened valleys (less than 100 nm), in contrast to other cases. , If any weak points exist, it should be more apparent for surfaces irradiated for long times, and the peel strength should decrease. (3) The system with NH 3 added shows different behaviors from the system with O 2 added due to different reaction modes.…”

“…This indicates that fewer surface radicals were generated on the PTFE surface for the former system. Figure shows the radical concentration on the ion-beam irradiated PTFE surface which was measured using an electron spin resonance spectrometer . The radical concentration increased with irradiation time.…”

New Synthetic Thiocolchicine Derivatives as Lowtoxic Anticancer Agents

“…The synthesis of compound 8 was accomplished in five steps from phytosphingosine via the key intermediate 8b in 28 % overall yield. Phytosphingosine was converted into the key intermediate 8b in 59 % overall yield via a modified synthesis we previously described [20]. The synthesis of the acid 8b is based on proper protection/deprotection of amino alcohols at the C-2, 3, 4 positions of phytosphingosine.…”