The short range behaviour of the nucleon-nucleon (NN) potential is studied in terms of the quark model, where nucleons are assumed to consist of three colored quarks. By considering the overlap kernel of the wave function of the resonating group method (RGM), it is found that the Pauli effect does not produce a ~hard core'. Instead, the gluon exchange interaction with the confinement requirement suggests a rather soft one. The A-A isobar interaction is also considered. In the (S, T)=(3, 3), (3, 2) and (2, 3) channels we find a 'hard core', while calculations in some other cases indicate even strong short range attractions.