Voting Advice Applications (VAAs) have proliferated in the last years in many European countries, and their effects have been extensively discussed. One of their main objectives is to increase voter's political competence by notifying users of their closest political party according to their own preferences. In order to do this, VAAs compare and aggregate users' and political parties' preferences on a set of policy issues. The main goal of this paper is to argue that current VAAs do not fulfill their stated aims. First, we discuss the notion of political competence advanced by VAAs. Second, we define four normative criteria to evaluate whether their methods of recommendation are likely to increase voters' political competence: informativeness, respect for users' way of comparing and aggregating policy issues, reliability, and transparency. Third, we argue that current VAAs compare and aggregate users' and parties' policy preferences following a weak method. It fails to respect sufficiently the users' way of comparing and aggregating policy issues and is not reliable. To prove it, we analyze the methodology of currents VAAs and use the outcomes from the EU-Vox 2014 in several countries. Fourth, we discuss the two possibilities by which VAAs could improve these problems: 1) by using ex-ante survey data to fill their gaps 2) by creating a learning algorithm to adapt the VAA to users' preferences. We found that some changes need to be made if VAAs aim to have an impact on users' political competence.