In real decision-making problems, decision makers (DMs) usually select the most potential project from several ones. However, they unconsciously show different confidence levels in decisionmaking process because they come from various backgrounds and have different experiences, etc., which affects the decision results. Moreover, the probabilistic linguistic term set, which not only includes the linguistic expressions used by DMs in their daily life but also contains the probability for each linguistic term, can well portray the real perceptions of DMs for the projects. Furthermore, large-scale consensus has gradually been a popular way to effectively solve complex decision-making problems. To sum up, in this paper, we are dedicated to constructing a largescale consensus model considering the confidence levels of DMs under probabilistic linguistic circumstance. Firstly, the endo-confidence is defined and measured by DM's probabilistic linguistic information. Then, the DMs are clustered according to the similarities of both evaluation information and the endo-confidence levels. Both evaluation of the non-consensus cluster and evaluation integrated by the clusters with higher endo-confidence level than this non-consensus cluster are used as the reference to adjust its evaluation information. Then, a case study and the comparative analysis are carried out. Finally, some conclusions and future work are given.