This study investigated the relation between annoyance and single-number quantities to rate heavy-weight floor impact sound insulation. Laboratory experiments were conducted to evaluate the subjective response of annoyance resulting from heavy-weight floor impact sounds recorded in wooden houses. Stimuli had two typical spectra and their modified versions, which simulate the precise change in frequency response resulting from insulation treatments. Results of the first experiment showed that the Zwicker's percentile loudness (N(5)) was the quantity to rate most well annoyance of heavy-weight impact sound over a wide sound level range. The second experiment revealed that arithmetic average (L(iFavg,Fmax)) of octave-band sound pressure levels measured using the time constant "fast" and Zwicker's percentile loudness (N(5)) much better described annoyance by the precise change in the sound spectrum attributable to insulation treatments than Japanese standardized single-number quantities (L(i,Fmax,r), L(iA,Fmax), and L(i,Fmax,Aw)) do. Japanese standardized single-number quantities using the A-weighting curve as a rating curve were found to be excessively influenced by the 63 Hz octave-band sound level and have the great sound level-dependences in the relation with subjective ratings.