Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Study

Chen, Yi‐Ling; Huang, Tzu-Wen; Chang, Kai-han; Tsai, Yu‐Chuan; Chen, Hwann-Tzong; Chen, Bing‐Yu

doi:10.1109/wacv.2017.32

Cited by 76 publications

(97 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The dense annotations of our GAICD enable us to define more reliable metrics to evaluate cropping performance than IoU or BDE used in previous databases [39,13,5]. We define two metrics on GAICD.…”

Section: Evaluation Metricsmentioning

confidence: 99%

“…Recently, several benchmark databases have been released for image cropping [39,13,5]. On these databases, one or several bounding boxes were annotated by experienced human subjects as "groundtruth" crops for each image.…”

Section: Introductionmentioning

confidence: 99%

“…Two objective metrics, namely intersection-overunion (IoU) and boundary displacement error (BDE) [14], were defined to evaluate the performance of image cropping models on these databases. These public benchmarks enable many researchers to develop and test their cropping models, significantly facilitating the research on automatic image cropping [39,11,34,5,6,10,15,22,36]. Though many efforts have been made, there exists sev- Table 1.…”

Section: Introductionmentioning

confidence: 99%

“…Method ICDB [39] FCDB [5] Set 1 Set 2 Set 3 Yan et al [39] 0.7487 0.7288 0.7322 -Chen et al [5] 0.6683 0.6618 0.6483 0.6020 Chen et al [6] 0.7640 0.7529 0.7333 0.6802 Wang et al [34] 0.8130 0.8060 0.8160 -Li et al [22] 0.8019 0.7961 0.7902 0.6633 Baseline N 0.8237 0.8299 0.8079 0.6379 Baseline C 0.7843 0.7599 0.7636 0.6647 eral intractable challenges caused by the special properties of image cropping. As illustrated in Fig.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Reliable and Efficient Image Cropping: A Grid Anchor Based Approach

Zeng

Cao

et al. 2019

2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

View full text Add to dashboard Cite

Image cropping aims to improve the composition as well as aesthetic quality of an image by removing extraneous content from it. Existing image cropping databases provide only one or several human-annotated bounding boxes as the groundtruth, which cannot reflect the non-uniqueness and flexibility of image cropping in practice. The employed evaluation metrics such as intersection-over-union cannot reliably reflect the real performance of cropping models, either. This work revisits the problem of image cropping, and presents a grid anchor based formulation by considering the special properties and requirements (e.g., local redundancy, content preservation, aspect ratio) of image cropping. Our formulation reduces the searching space of candidate crops from millions to less than one hundred. Consequently, a grid anchor based cropping benchmark is constructed, where all crops of each image are annotated and more reliable evaluation metrics are defined. We also design an effective and lightweight network module, which simultaneously considers the region of interest and region of discard for more accurate image cropping. Our model can stably output visually pleasing crops for images of different scenes and run at a speed of 125 FPS. Code and dataset are available at: https://github.com/HuiZeng/ Grid-Anchor-based-Image-Cropping.

show abstract

Section: Evaluation Metricsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Reliable and Efficient Image Cropping: A Grid Anchor Based Approach

Zeng

Cao

et al. 2019

2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

View full text Add to dashboard Cite

show abstract

“…They allow the creation of models that can analyze any picture and predict their aesthetic value, without the need for any annotated data about its contents; and without making use of hand-crafted features. Some examples of the use of CNNs for image aesthetics prediction and related topics can be found in [2,20,33,6,11,4,9,35,10,17]. Some of those papers make use of information about the contents of the pictures to improve the predictions of the models.…”

Section: Related Work 21 Computational Aesthetic Assessment In Photomentioning

confidence: 99%

Personalised Aesthetics with Residual Adapters

Rodríguez-Pardo

Bilen

2019

Pattern Recognition and Image Analysis

View full text Add to dashboard Cite

The use of computational methods to evaluate aesthetics in photography has gained interest in recent years due to the popularization of convolutional neural networks and the availability of new annotated datasets. Most studies in this area have focused on designing models that do not take into account individual preferences for the prediction of the aesthetic value of pictures. We propose a model based on residual learning that is capable of learning subjective, userspecific preferences over aesthetics in photography, while surpassing the stateof-the-art methods and keeping a limited number of user-specific parameters in the model. Our model can also be used for picture enhancement, and it is suitable for content-based or hybrid recommender systems in which the amount of computational resources is limited.The problem of taking into account subjective preferences on image aesthetics prediction is referred to as personalized image aesthetics [27]. Most recent approaches to image aesthetics evaluation have used different deep-learning models, which require a significant amount of annotated data for their training and evaluation. In real-world situations, it is unrealistic to assume that we will have thousands of annotated examples of rated images for any given user. This puts limits on the use of deep learning models for personalized image aesthetics prediction.In order to train a machine learning model capable of taking into account individual preferences over aesthetics in photography, an annotated dataset with the identities of the raters of each picture is needed. One example of this kind of dataset is the FLICKER-AES dataset, presented by Ren et al. [27], which contains over 40000 images rated by more than 200 different human raters. Their study provides, along with this dataset (and another, smaller, dataset), a residual-based learning model capable of taking into account user-specific preferences over aesthetics in photography.We build on their work, and propose an end-to-end convolutional neural network model capable of modelling user-specific preferences with different levels of abstraction, while keeping a reduced number of user-specific parameters within the model. Our method models user-specific preferences by using residual adapters, which were presented in [26,25] and have shown success in multi-domain learning. The main difference between our model and Ren et al.'s is that they model user-specific preferences by first training a generic aesthetics network, which predicts a mean aesthetic score, and computes a user-specific offset by training a Support Vector Regressor using the predicted content and some manually-defined attributes of the picture as its input; whereas our model embeds the user-specific parameters in different layers of the neural network, therefore allowing the model to find user-specific features with different levels of abstraction, and which do not necessarily depend on the contents and a fixed set of attributes of the pictures.Our main contributions are as follows: First, we propo...

show abstract

PC‐SNet for automated detection of prostate cancer in multiparametric‐magnetic resonance imaging

Juneja

Saini

Acharjee

et al. 2022

Int J Imaging Syst Tech

View full text Add to dashboard Cite

Prostate cancer (PCa) is responsible for the maximum deaths of men across the world after lung cancer; hence, it should be diagnosed in the initial stages. Magnetic resonance imaging (MRI) commonly diagnoses PCa due to better visibility of desired organ and cancerous region over other modalities. Therefore, development of MRI-based computer-aided diagnosis (CAD) systems for PCa has become a recent area of research. Conventional methodologies used by researchers and radiologists were time consuming and prone to subjective errors due to manual interpretation. Thus, the CAD system helps in the early detection of PCa by reducing the computational complexity and increasing the detection accuracy with less chances of subjective errors. This article proposes a deep learning-based methodology named prostate cancer segmentation network (PC-SNet) for the segmentation of the region of interest (ROI) from the MRI sub-modalities T2-weighted (T2W) and dynamic contrast enhanced (DCE). Further, the performance is analyzed using parameters such as accuracy, Mathews correlation coefficient (MCC), dice similarity coefficient (DSC), Jaccard Index (JI) or intersection over union (IOU), F-score, and Hausdorff distance (HD). Finally, the performance of PC-SNet is found to outperform fully convolutional network (FCN), semantic pixel wise segmentation (SegNet), residual network (ResNet), UNet, and ENet architectures.

show abstract

Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Study

Cited by 76 publications

References 36 publications

Reliable and Efficient Image Cropping: A Grid Anchor Based Approach

Reliable and Efficient Image Cropping: A Grid Anchor Based Approach

Personalised Aesthetics with Residual Adapters

PC‐SNet for automated detection of prostate cancer in multiparametric‐magnetic resonance imaging

Contact Info

Product

Resources

About