As an extension of fuzzy sets, hesitant bipolar-valued fuzzy set is a new mathematical tool for dealing with fuzzy problems, but it still has the problem with the inadequacy of the parametric tools. In order to further improve the accuracy of decision making, a new mixed mathematical model, named hesitant bipolar-valued fuzzy soft set, is constructed by combining hesitant bipolar-valued fuzzy sets with soft sets. Firstly, some related theories of hesitant bipolar-valued fuzzy sets are discussed. Secondly, the concept of hesitant bipolar-valued fuzzy soft set is given, and the algorithms of complement, union, intersection, “AND,” and “OR” are defined. Based on the above algorithms, the corresponding results of operation are analyzed and the relevant properties are discussed. Finally, a multiattribute decision-making method of hesitant bipolar-valued fuzzy soft sets is proposed by using the idea of score function and level soft sets. The effectiveness of the proposed method is illustrated by an example.