Text detection in natural scene images is an important prerequisite for many content-based image analysis tasks. In this paper, we propose an accurate and robust method for detecting texts in natural scene images. A fast and effective pruning algorithm is designed to extract Maximally Stable Extremal Regions (MSERs) as character candidates using the strategy of minimizing regularized variations. Character candidates are grouped into text candidates by the single-link clustering algorithm, where distance weights and clustering threshold are learned automatically by a novel self-training distance metric learning algorithm. The posterior probabilities of text candidates corresponding to non-text are estimated with a character classifier; text candidates with high non-text probabilities are eliminated and texts are identified with a text classifier. The proposed system is evaluated on the ICDAR 2011 Robust Reading Competition database; the f-measure is over 76%, much better than the state-of-the-art performance of 71%. Experiments on multilingual, street view, multi-orientation and even born-digital databases also demonstrate the effectiveness of the proposed method.

A characteristic clinical feature of COVID-19 is the frequent incidence of microvascular thrombosis. In fact, COVID-19 autopsy reports have shown widespread thrombotic microangiopathy characterized by extensive diffuse microthrombi within peripheral capillaries and arterioles in lungs, hearts, and other organs, resulting in multiorgan failure. However, the underlying process of COVID-19-associated microvascular thrombosis remains elusive due to the lack of tools to statistically examine platelet aggregation (i.e., the initiation of microthrombus formation) in detail. Here we report the landscape of circulating platelet aggregates in COVID-19 obtained by massive single-cell image-based profiling and temporal monitoring of the blood of COVID-19 patients (n = 110). Surprisingly, our analysis of the big image data shows the anomalous presence of excessive platelet aggregates in nearly 90% of all COVID-19 patients. Furthermore, results indicate strong links between the concentration of platelet aggregates and the severity, mortality, respiratory condition, and vascular endothelial dysfunction level of COVID-19 patients.

Generating captions for images is a task that has recently received considerable attention. In this work we focus on caption generation for abstract scenes, or object layouts where the only information provided is a set of objects and their locations. We propose OBJ2TEXT, a sequence-tosequence model that encodes a set of objects and their locations as an input sequence using an LSTM network, and decodes this representation using an LSTM language model. We show that our model, despite encoding object layouts as a sequence, can represent spatial relationships between objects, and generate descriptions that are globally coherent and semantically relevant. We test our approach in a task of object-layout captioning by using only object annotations as inputs. We additionally show that our model, combined with a state-of-the-art object detector, improves an image captioning model from 0.863 to 0.950 (CIDEr score) in the test benchmark of the standard MS-COCO Captioning task.

Cell image classification methods are currently being used in numerous applications in cell biology and medicine. Applications include understanding the effects of genes and drugs in screening experiments, understanding the role and subcellular localization of different proteins, as well as diagnosis and prognosis of cancer from images acquired using cytological and histological techniques. The article also reviews three main approaches for cell image classification most often used: numerical feature extraction, end-to-end classification with neural networks (NNs), and transport-based morphometry (TBM). In addition, we provide comparisons on four different cell imaging datasets to highlight the relative strength of each method. The results computed using four publicly available datasets show that numerical features tend to carry the best discriminative information for most of the classification tasks. Results also show that NN-based methods produce state-of-the-art results in the dataset that contains a relatively large number of training samples. Data augmentation or the choice of a more recently reported architecture does not necessarily improve the classification performance of NNs in the datasets with limited number of training samples. If understanding and visualization are desired aspects, TBM methods can offer the ability to invert classification functions, and thus can aid in the interpretation of results. These and other comparison outcomes are discussed with the aim of clarifying the advantages and disadvantages of each method. © 2020 International Society for Advancement of Cytometry Key terms image informatics; computational biology; cell biology; digital pathology Interpretation of images of cells has always played important roles in science and medicine. From their discovery in 1665, observation of the spatiotemporal characteristics of cells through microscopic technology has enabled us to better understand the structure of living cells, as well as how they perform certain functions (1,2). In addition, scientists have long used microscopes to evaluate the efficacy of different compounds for drug development (3-9). In medicine, as another example, the observation of cell morphology has long been used to discern malignancy in cancer cells (10-13).Cells are known to exhibit complex phenotypes such as differences in shape, gene expression, subcellular protein localization, and other qualities. In addition, cell cultures, tissues, and organs are known to exhibit complex heterogeneity of phenotypes. The combination of intricate phenotype differences together with their heterogeneous responses to different conditions (e.g., diseases) has made decoding biological processes an increasingly complex task. Thus computational approaches for analyzing images of cells have been used increasingly to aid in the task of decoding the complexity of biological processes. A common task useful in many practical situations is determining the category of a given cell or set of cells: a task known as cell classification.Auto...

No abstract