The mobility of dislocations is an important factor in understanding material strength. Dislocations experience a drag due to their interaction with the crystal structure, the dominating contribution at high stress and temperature being the scattering off phonons due to phonon wind. Yet, the velocity dependence of this effect has eluded a good theoretical understanding. In a previous paper, dislocation drag from phonon wind as a function of velocity was computed from first principles in the isotropic limit, in part for simplicity, but also arguing that macroscopically, a polycrystalline metal looks isotropic. However, since the single crystal grains are typically a few microns up to a millimeter in size, dislocations travel in single crystals and cross boundaries, but never actually see an isotropic material. In this work we therefore highlight the effect of crystal anisotropy on dislocation drag by accounting for the crystal and slip plane geometries. In particular, we keep the phonon spectrum isotropic for simplicity, but dislocations are modeled according to the crystal symmetry (bcc, fcc, hcp, etc.). We then compare to the earlier purely isotropic results, as well as to experimental data and MD simulations where they are available.