Gamma ray bursts (GRBs) are classified into long and short categories based on their durations. Broad band studies suggest that these two categories of objects roughly correspond to two different classes of progenitor systems, i.e. compact star mergers (Type I) vs. massive star core collapse (Type II). However, the duration criterion sometimes leads to mis-identification of the progenitor systems. We perform a comprehensive multi-wavelength comparative study between duration-defined long GRBs and short GRBs as well as the so-called "consensus" long GRBs and short GRBs (which are believed to be more closely related to the two types of progenitor systems). The parameters we study include two parts: the prompt emission properties including duration (T 90 ), spectral peak energy (E p ), low energy photon index (α), isotropic γ-ray energy (E γ,iso ), isotropic peak luminosity (L p,iso ), and the amplitude parameters (f and f eff ); and the host galaxy properties including stellar mass (M * ), star formation rate (SFR), metallicity ([X/H]), half light radius (R 50 ), angular and physical (R off ) offset of the afterglow from the center of the host galaxy, the normalized offset (r off = R off /R 50 ), and the brightness fraction F light . For most parameters, we find interesting overlapping properties between the two populations in both 1D and 2D distribution plots. The three best parameters for the classification purpose are T 90 , f eff , and F light . However, no single parameter alone is good enough to place a particular burst into the right physical category, suggesting a need of multiple criteria for physical classification.