Current infrared spectroscopy applications in the field of viticulture are moving toward direct in-field measuring techniques. However, limited research is available on quantitative applications using direct measurement of fresh tissue. The few studies conducted have combined the spectral data from various cultivars, growing regions, grapevine organs, and phenological stages during model development. The spectral data from these heterogeneous samples are combined into a single data set and analyzed jointly during quantitative analysis. Combining the spectral information of these diverse samples into a global data set could be an unsuitable approach and could yield less accurate prediction results. Spectral differences among samples could be overlooked during model development and quantitative analysis. The development of specialized calibrations should be considered and could lead to more accurate quantitative analyses. This study explored a model optimization strategy attempting global and specialized calibrations. Global calibrations, containing data from multiple organs, berry phenological, and shoot lignification stages, were compared to specialized calibrations per organ or stage. The global calibration for organs contained data from shoots, leaves, and berries and produced moderately accurate prediction results for nitrogen, carbon, and hydrogen. The specialized calibrations per organ yielded more accurate calibrations with a coefficient of determination in validation (R2val) at 90.65% and a root mean square error of prediction (RMSEP) at 0.32% dry matter (DM) for the berries’ carbon calibrations. The leaves and shoots carbon calibrations had R2val and RMSEP at 84.99%, 0.34% DM, and 90.06%, 0.37% DM, respectively. The specialized calibrations for nitrogen and hydrogen showed similar improvements in prediction accuracy per organ. Specialized calibrations per phenological and lignification stage were also explored. Not all stages showed improvement, however, most stages had comparable or improved results for the specialized calibrations compared to the global calibrations containing all phenological or lignification stages. The results indicated that both global and specialized calibrations should be considered during model development to optimize prediction accuracy.