In this work, a reliable and robust in situ non-matrix-matched calibration method is proposed for element composition determination in scheelite samples. With external calibration against the silicate glass standard reference material NIST SRM 610, the concentrations of both major elements (Ca and W) and trace elements (Si, Fe, Mo, Y, rare earth elements, etc.) in scheelite are determined using an ArF 193 nm excimer nanosecond laser ablation-inductively coupled plasma mass spectrometer (LA-ICP-MS). Here, the ablation was performed by hole drilling under a helium (He) environment using a laser spot size of 35 μm and a laser repetition of 5 Hz, and the aerosols were then transported to a quadrupole ICP-MS by a mixture of He and make-up gas argon (Ar) with a total gas flow rate of 1.6 L/min. Results showed that there was no apparent matrix effect between the NIST SRM 610 and scheelite by this proposed method. With internal standardization against W, the obtained concentrations of CaO and WO3 were found to yield an average matrix CaO/WO3 mass fraction ratio of 0.245 (2σ = 0.003, n = 19), which agreed well with the value of 0.243 (2σ = 0.002, n = 15) from electron probe microanalysis (EPMA). Furthermore, the accuracy of trace element analyses with this proposed non-matrix-matched calibration in situ method was evaluated by comparing the concentration results with those from bulk analysis by solution nebulizer ICP-MS (SN-ICP-MS). It was found that the quantification results from LA-ICP-MS and SN-ICP-MS were comparable, in particular showing a relative concentration bias of the total ∑REE+Y contents of less than 2%. This confirmed that scheelites can be accurately analyzed in situ by LA-ICP-MS without matrix-matched calibration standards. By using this developed in situ method, the element compositions in a series of scheelite samples from different W-associated deposits in China were successfully quantified, promising further genetic process investigation and associated geologic activities of the polymetallic resources.