The mechanical properties of carbon nanotube/polymer composites are determined using a multi-scale approach. Starting bottom-up, the stiffness of equivalent cylinders is calculated to replace the randomly distributed carbon nanotubes in the polymer matrix. In the following, finite element simulations of the CNT/polymer composites are conducted to determine the mechanical properties of the composite. Furthermore, micromechanical homogenization techniques like Mori-Tanaka are investigated and compared with the presented approach.