We demonstrate that the uniaxial magnetic anisotropy (UMA) of amorphous CoFeB films can be tuned by crystallinity and orbital moment ratio, combining the results of magnetization reversal and ferromagnetic resonance with high-resolution transmission electron microscopy, x-ray-absorption near-edge structure and x-ray magnetic circular dichroism. Isotropic polycrystalline buffers of tungsten (W), tantalum (Ta), and copper (Cu) between CoFeB and Si(100) substrates have direct and crucial bearing on the interfacial microstructure and orbital moment ratio. Compared with Ta and Cu buffer, CoFeB with W buffer exhibits obvious UMA and has lower crystallinity at the interface and higher orbital moment. Amorphous phase distributed homogeneously in CoFeB film grown on W buffer contributes to improve the easy-axis squareness with a sharp magnetization reversal. Our demonstrations not only realize effective tuning of UMA in amorphous CoFeB, but also provide an appealing alternative buffer (W) for CoFeB-based magnetic tunnel junctions.