Composite materials, such as fiber reinforced polymers, become increasingly important due to their excellent mechanical and lightweight properties. In this respect, this paper reports the characterization of a unidirectional carbon fiber reinforced polymer composite material. Particularly, the mechanical behavior of the overall composite and of the individual constituents of the composite is investigated. To this end, tensile and shear tests are performed for the composite. As a result, statistics for five transversely isotropic material parameters can be established for the composite. For the description of the mechanical properties of the constituents, tensile tests for the carbon fiber as well as for the polymer matrix are carried out. In addition, the volume fraction of fibers in the matrix is determined experimentally using an ashing technique and Archimedes’ principle. For the Young’s modulus of the fiber, the Young’s modulus and transverse contraction of the matrix, as well as the volume fraction of the constituents, statistics can be concluded. The resulting mechanical properties on both scales are useful for the application and validation of different material models and homogenization methods. Finally, in order to validate the obtained properties in the future, inhomogeneous tests were performed, once a flat plate with a hole and a flat plate with semicircular notches.