A study of the magnetic behavior of a mixed Ising system on a square lattice, where spins σ=±1/2 are located on alternating sites with spins S=±3/2,±1/2, is presented. The change in the magnetic behavior of the system when empty sites are introduced in one of the sublattices or in both is analyzed. This system can be thought of as a site‐diluted ferrimagnet or as a system with nonmagnetic impurities. The Hamiltonian of the model contains an exchange interaction between nearest neighbors S–σ, next‐nearest‐neighbors σ–σ, and a crystal field. The dependence of the total magnetization, the sublattice magnetizations, and the specific heat, with dilution is calculated. It is found that the behavior of the critical and compensation temperatures is strongly affected by dilution and where it is located. There is critical dilution, above which the compensation temperature disappears.