The study of the source rocks was carried out with the use of various analytical methods in order to assess their generation potential and to predict the decomposition products of organic matter. The selected samples from the Menilite Beds from the Silesian and Dukla units, as well as the Istebna layers from the Silesian unit, which are classified as weak and medium source rocks in the Carpathian oil system, were examined. The generation potential and type of the products obtained from the pyrolysis of the analyzed source rocks, despite the often comparable overall content of organic matter, are significantly different. Menilite shale generated a higher abundance of hydrocarbons (alkanes, alkenes, and isoalkanes) by stage pyrolysis, which suggested that the organic matter of Menilite shale is different from the Istebna source rocks. Moreover, the thermogravimetric analysis showed a two-stage weight loss in the case of Menilite shales, while the Istebna shales were characterized by a one-stage weight loss at higher temperature. For the Istebna layers, n-alkanes from the C1–C5 range were detected as the main pyrolysis products, which proves the gas-forming type of the organic matter dispersed in these sediments. Rock-Eval analyses showed that the organic matter reached a degree of maturity corresponding to the early thermocatalytic processes (the initial oil window stage) and therefore was able to generate liquid and gaseous hydrocarbons. The comparison of the decomposition temperatures of the organic matter from the Rock-Eval and TG analyses allowed us to conclude that both measurements correlate well and can be equally used to assess the level of thermal transformations of organic matter.