A new type of conjugated polybenzimidazole (CPBI) was synthesized through a simple polycondensation reaction without metal catalysis, and N-alkylation modification was carried out to solve the problems of solubility and fluorescence properties. A series of nano-microsphere polymers CPBIn with large conjugation, good solubility, and strong fluorescence has been successfully used as “turn-off” fluorescent probes for the first time. The results show that, under suitable N-alkylation conditions, the obtained CPBIn can be used as a highly sensitive and selective fluorescent probe for the detection of Cu2+ and Zn2+ at the same time, and their detection limits are both nM levels. In addition, CPBI2 can be designed as an ultra-sensitive IMPLICATION logic gate at the molecular level, cyclically detecting Cu2+. With the test paper containing CPBI2, easy and quick on-site detection can be achieved. This research provides a new idea for the brief synthesis of multifunctional materials.