For large infrastructure projects, such as high-voltage underground cables or for evaluating the very shallow geothermal potential (vSGP) of small-scale horizontal geothermal systems, large-scale geothermal collector systems (LSCs), and fifth generation low temperature district heating and cooling networks (5GDHC), the thermal conductivity (λ) of the subsurface is a decisive soil parameter in terms of dimensioning and design. In the planning phase, when direct measurements of the thermal conductivity are not yet available or possible, λ must therefore often be estimated. Various empirical literature models can be used for this purpose, based on the knowledge of bulk density, moisture content, and grain size distribution. In this study, selected models were validated using 59 series of thermal conductivity measurements performed on soil samples taken from different sites in Germany. By considering different soil texture and moisture categories, a practicable guideline in the form of a decision tree, employed by empirical models to calculate the thermal conductivity of unconsolidated soils, was developed. The Hu et al. (2001) model showed the smallest deviations from the measured values for clayey and silty soils, with an RMSE value of 0.20 W/(m∙K). The Markert et al. (2017) model was determined to be the best-fitting model for sandy soils, with an RMSE value of 0.29 W/(m∙K).