In this paper, we study mainly on a class of column upper-minus-lower (CUML) Toeplitz matrices without standard Toeplitz structure, which are " similar" to the Toeplitz matrices. Their (−1, −1)-cyclic displacements coincide with cyclic displacement of some standard Toeplitz matrices. We obtain the formula on representation for the inverses of CUML Toeplitz matrices in the form of sums of products of (−1, 1)-circulants and (1, −1)-circulants factor by constructing the corresponding displacement of the matrices. In addition, based on the relation between CUML Toeplitz matrices and CUML Hankel matrices, the inverse formula of CUML Hankel matrices can also be obtained.