Deciphering cell-type-specific 3D structures of chromatin is challenging. Here, we present InferLoop, a novel method for inferring the strength of chromatin interaction using single-cell chromatin accessibility data. The workflow of InferLoop is, first, to conduct signal enhancement by grouping nearby cells into bins, and then, for each bin, leverage accessibility signals for loop signals using a newly constructed metric that is similar to the perturbation of the Pearson correlation coefficient. In this study, we have described three application scenarios of InferLoop, including the inference of cell-type-specific loop signals, the prediction of gene expression levels and the interpretation of intergenic loci. The effectiveness and superiority of InferLoop over other methods in those three scenarios are rigorously validated by using the single-cell 3D genome structure data of human brain cortex and human blood, the single-cell multi-omics data of human blood and mouse brain cortex, and the intergenic loci in the GWAS Catalog database as well as the GTEx database, respectively. In addition, InferLoop can be applied to predict loop signals of individual spots using the spatial chromatin accessibility data of mouse embryo. InferLoop is available at https://github.com/jumphone/inferloop.