The subject of this study is how, and to what extent, Varestraint/Transvarestraint test results are influenced by both testing parameters and characteristics of evaluation methods. Several different high-alloyed martensitic LTT (low transformation temperature) filler materials, CrNi and CrMn type, were selected for examination due to their rather distinctive solidification cracking behaviour, which aroused interest after previous studies. First, the effects of different process parameter sets on the solidification cracking response were measured using standard approaches. Subsequently, microfocus X-ray computer tomography (μCT) scans were performed on the specimens. The results consistently show sub-surface cracking to significant yet varying extents. Different primary solidification types were found using wavelength dispersive X-ray (WDX) analysis conducted on filler metals with varying Cr/Ni equivalent ratios. This aspect is regarded as the main difference between the CrNiand CrMn-type materials in matters of cracking characteristics. Results show that when it comes to testing of modern highperformance alloys, one set of standard Varestraint testing parameters might not be equally suitable for all materials. Also, to properly accommodate different solidification types, sub-surface cracking has to be taken into account.