Background and objective The number of people suffering from dementia is increasing worldwide and so is the need for reliable and economical diagnostic instruments. Therefore, the aim of this study was to compare the processing times of the neuropsychological tests Trail Making Tests A and B (TMT-A/B) and Color-Word Interference Test (CWIT), which were performed in both digital and paper versions. Methods The pilot study was conducted among 50 healthy participants (age 65–83 years) using a randomized crossover design. The correlations and differences in the individual processing times of the two test versions were statistically analyzed. Further research questions concerned the influence of the individual usage of technology and the technology commitment of participants as well as the influence of the assessed usability on participants’ performance. Results Between the two versions (paper-based vs. digital) statistically significant correlations were found in all tests, e.g., TMT-A r(48) = 0.63, p < 0.01; TMT-B rs(48) = 0.77, p < 0.001). The mean value comparison showed statistically significant differences, e.g., interference table (CWIT) t(49) = 11.24, p < 0.01). Correlations with medium effect were found between the differences in processing times and the individual usage of computer (e.g., rs(48) = − 0.31) and smartphone (rs(48) =  − 0.29) and between the processing times of the TMT-B and the usability (rs(48) = 0.29). Conclusions The high correlations between the test procedures appear promising. However, the differences found in the processing times of the two test versions require validation and standardization of digitized test procedures before they can be used in practice.