Prioritizing molecules for synthesis is a key role of computational methods within medicinal chemistry. Multiple tools exist for ranking molecules, from the cheap and popular molecular docking methods to more computationally expensive molecular‐dynamics (MD)‐based methods. It is often questioned whether the accuracy of the more rigorous methods justifies the higher computational cost and associated calculation time. Here, we compared the performance on ranking the binding of small molecules for seven scoring functions from five docking programs, one end‐point method (MM/GBSA), and two MD‐based free energy methods (PMX, FEP+). We investigated 16 pharmaceutically relevant targets with a total of 423 known binders. The performance of docking methods for ligand ranking was strongly system dependent. We observed that MD‐based methods predominantly outperformed docking algorithms and MM/GBSA calculations. Based on our results, we recommend the application of MD‐based free energy methods for prioritization of molecules for synthesis in lead optimization, whenever feasible.