Detailed characteristics of radio frequency (rf) waves with pulsed modes in the whistler wave range were studied in a cylindrical rf-produced plasma, where the plasma boundary lay in the intermediate regime between infinite whistler wave propagation and bounded geometry helicon wave propagation. Excited magnetic field amplitudes and phases with three components in two-dimensional space were measured for different experimental conditions. Three magnetic field configurations were used and the diameter of the excitation loop antenna was also varied. Numerical calculation by the finite element method, which has been demonstrated to be a powerful means for this analysis, showed good agreement with the observed results, satisfying the dispersion relation and wave structures of helicons in the semisteady state and also satisfying the dispersion of whistlers with a short pulsed mode. The excited waves propagated nearly along the magnetic field lines within a small angle of less than 10°. Furthermore, in the low (high) collisionality regime, domination of standing (propagating) waves was found from the wave analysis.