Root hairs play an important role in phosphorus (P) nutrition of plants. To better understand the relationship between root hairs and P acquisition efficiency (PAE) in barley, experiments were conducted with the wild-type barley (cv. ’Pallas’) and its root-hairless mutant (brb). A hydroponic split-root system was used to supply P as Ca3(PO4)2 (tri-calcium phosphate, TCP) to one-half and other nutrients to the other half of the root system. Using TCP as a sole P source can simulate a soil solution with buffered low P concentration in hydroponics to induce prolific root hair growth. Root morphology, plant growth, and P uptake efficiency were measured with 50 mg L−1 TCP supplied to the roots in the split-root system and 0, 35, or 1000 μM NaH2PO4 in a non-split-root hydroponic system. The wild-type plants developed root hairs, but they did not contribute to the significant genotypic differences in the P uptake rate when a soluble P source was supplied in the non-split root system, indicating that root hair formation does not contribute to P uptake in a non-split root solution. On the other hand, when grown in a split-root system with one-half of the roots supplied with TCP, the wild-type showed 1.25-fold greater P uptake than the root hairless mutant. This study provides evidence that root hairs play an essential role in plant P uptake when P bioavailability is limited in the root zone.