To perform a reliable performance evaluation under realistic boundary conditions, in the last twenty years, different research institutes have developed and applied whole system test methods. The methodologies are based on a common approach but the literature presents several differences on the steps that compose the test methods. This leads to different advantages and drawbacks. The paper compares two methodologies in order to investigate on the different results that could be obtained in the same conditions applying two different methodologies. In this paper, we analyze the difference between the CCT method and the PLPE method in terms of boundary conditions (test sequences and load) and present a common application case. Despite the different procedures in the definition of test sequence and emulations, the two methods bring to similar results in the characterization of the seasonal performance of a solar and heat pump system. The CCT method estimates a SPF of 4.09 while the PLPE 4.13.