The hesitant fuzzy linguistic term set is an effective tool to express qualitative evaluations since it is close to human reasoning and expressing habits. In this paper, we propose a multi-expert multi-criterion decision-making method integrating the double normalization-based multi-aggregation (DNMA) method with a cardinal consensus reaching process, where the assessments of alternatives over multiple criteria are expressed as hesitant fuzzy linguistic term sets. To do so, the DNMA method involving double normalizations and three aggregation tools is extended to deal with the hesitant fuzzy linguistic information and derive the ranking of alternatives with respect to each expert. In addition, a cardinal consensus reaching process is introduced to help experts reach an acceptable consensus level. In other words, the soft consensus is considered in the multi-expert multi-criterion decision-making process. Subsequently, an extended Borda rule is developed to aggregate the subordinate ranks and integrated scores of alternatives, and then deduce the comprehensive ranking of alternatives. A case study is given to illustrate the practicability of the proposed method for selecting the optimal geographical location of a larger-scale shopping mall in the new urbanization for a construction investment agency. The proposed method is compared with other ranking methods to illustrate its advantages.