PVDF electrospun membranes were prepared by employing different mixtures of solvents and diverse electrospinning parameters. A comprehensive investigation was carried out, including morphology, nanofiber diameter, crystallinity, β-phase fraction, and piezoelectric response under external mechanical strain. It was demonstrated that by using low-toxicity DMSO as the solvent, PVDF membranes with good morphology (bead-free, smooth surface, and uniform nanofiber) can be obtained. All the fabricated membranes showed crystallinity and β-phase fraction above 48% and 80%, respectively; therefore, electrospinning is a good method for preparing PVDF membranes with the piezoelectric properties. Moreover, we considered a potential effect of the solvent properties and the electrospinning parameters on the final piezoelectric properties. When PVDF membranes with different β-phase fractions and crystallinity values are applied to make the piezoelectric transducers, various piezoelectric voltage outputs can be obtained. This paper provides an effective and efficient strategy for regulating the piezoelectric properties of PVDF electrospun membranes by controlling both solvent dipole moment and process parameters. To the best of our knowledge, this is the first time that the influence of a solvent’s dipole moment on the piezoelectric properties of electrospun materials has been reported.