In the multi-criteria group decision-making (MCGDM) problems with great uncertainty, making full use of participants' evaluation information could help improve the accuracy and reliability of decision results. Probabilistic linguistic term set (PLTS) is an effective tool to represent qualitative data and can fully express the hesitation and preference of decision makers. Therefore, this paper aims to propose an MCGDM method based on PLTSs. In the proposed method, the projection of PLTSs is explored to measure the distance and angle differences between two objects, and Bayesian best-worst method (Bayesian BWM) is used to determine the aggregated final weights of criteria. Besides, the elimination and choice translating reality III (ELECTRE III) method combined with distillation algorithm deals with the projection of PLTSs to obtain the alternatives' ranking of each decision maker. Then, the weighted convex median voting rule is developed to integrate the rankings results regarding all decision makers, which can solve the conflict of ranking results among experts and ensure that the comprehensive ranking results are reasonable and practical. Finally, a case study of health-care waste management is designed and comparative analyses are implemented to show the effectiveness and advantages of the proposed method.