A systematic study of the influence of the chemical substitution pattern of semiconducting polymers carrying side chain perylene diimide (PDI) groups is presented. Semiconducting polymers based on perflurophenyl quinoline (5FQ) were modified via a readily accessible nucleophilic substitution reaction. The perfluorophenyl group was studied as an electron-withdrawing reactive functionality on semiconducting polymers that can undergo fast nucleophilic aromatic substitution. A PDI molecule, functionalized with one phenol group on the bay area, was used for the substitution of the fluorine atom at the para position in 6-vinylphenyl-(2-perfluorophenyl)-4-phenyl quinoline. The final product was polymerized under free radical polymerization providing polymers of 5FQ incorporated with PDI side groups. Alternatively, the post-polymerization modification of the fluorine atoms at the para position of the 5FQ homopolymer with the PhOH-di-EH-PDI was also successfully tested. In this case, the PDI units were partially introduced to the perflurophenyl quinoline moieties of the homopolymer. The para-fluoro aromatic nucleophilic substitution reaction was confirmed and estimated via 1H and 19F NMR spectroscopies. The two different polymer architectures, namely, fully or partially modified with PDI units, were studied in terms of their optical and electrochemical properties, while their morphology was evaluated using TEM analysis, revealing polymers of tailor-made optoelectronic and morphological properties. This work provides a novel molecule-designing method for semiconducting materials of controlled properties.