The pressure dependence of the structural (Ts), antiferromagnetic (Tm), and superconducting (Tc) transition temperatures in FeSe is investigated on the basis of the 16-band d-p model. At ambient pressure, a shallow hole pocket disappears due to the correlation effect, as observed in the angular-resolved photoemission spectroscopy (ARPES) and quantum oscillation (QO) experiments, resulting in the suppression of the antiferromagnetic order, in contrast to the other iron pnictides. The orbital-polarization interaction between the Fe d orbital and Se p orbital is found to drive the ferro-orbital order responsible for the structural transition without accompanying the antiferromagnetic order. The pressure dependence of the Fermi surfaces is derived from the first-principles calculation and is found to well account for the opposite pressure dependences of Ts and Tm, around which the enhanced orbital and magnetic fluctuations cause the double-dome structure of the eigenvalue λ in the Eliashberg equation, as consistent with that of Tc in FeSe.