New synergic behavior is always inspiring scientists toward the formation of nanocomposites aiming at getting advanced materials with superior performance and/or novel properties. Carbon nanotubes (CNT), graphene, fullerene, and graphite as carbon-based are great fillers for polymeric materials. The presence of these materials in the polymeric matrix would render it several characteristics, such as electrical and thermal conductivity, magnetic, mechanical, and as sensor materials for pressure and other environmental changes. This review presents the most recent works in the use of CNT, graphene, fullerene, and graphite as filler in different polymeric matrixes. The primary emphasis of this review is on CNT preparation and its composites formation, while others carbon-based nano-fillers are also introduced. The methods of making polymer nanocomposites using these fillers and their impact on the properties obtained are also presented and discussed.