We propose a novel matrix regularization for tensor fields. In this regularization, tensor fields are described as rectangular matrices and both area-preserving diffeomorphisms and local rotations of the orthonormal frame are realized as unitary similarity transformations of matrices in a unified way. We also show that the matrix commutator corresponds to the covariantized Poisson bracket for tensor fields in the large-N limit.