This article is focused on the comparison of dyeing, and washing and light fastness properties of conventional and novel perlite-containing polyester woven fabrics via color measurements. All the production processes for the regular and perlite-containing polyester filament yarns were the same. The fabrics were dyed with three medium level energy disperse dyes of different hues in order to observe the shade change caused by the intrinsic yellowness of the perlite-containing fabric. Dyeing and fastness properties of the dyed fabrics were evaluated by their corresponding lightness (L*), chroma (C*), color strength (K/S), and color difference (ΔEab*) results. The perlite-containing fabrics showed similar dyeing and fastness characteristics when compared with the regular fabrics. The perlite-added fabrics were dyed in darker color but had lower chroma values than the regular ones. The perlite-added fabrics also had better fastness results than the regular fabrics when the evaluation was performed in the group itself. Intrinsic yellowness of perlite-added fabrics must be taken into account for any attempt to dye the fabric to a pre-designed shade.