In this work, we report the fabrication and functional demonstration of a kind of dually responsive nanoparticles (NPs) as a potential drug delivery vector. The pH value, corresponding to the acidic microenvironment at the tumor site, and mannitol, to the extracellular trigger agent, were employed as the dually responsive factors. The function of dual responses was achieved by breaking the dynamic covalent bonds between phenylboronic acid (PBA) groups and diols at low pH value (pH 5.0) and/or under the administration of mannitol, which triggered the decomposition of the complex NPs and the concomitant release of anticancer drug of doxorubicin (DOX) loaded inside the NPs. The NPs were composed of modified chitosan (PQCS) with quaternary ammonium and PBA groups on the side chains, heparin (Hep), and poly(vinyl alcohol) (PVA), in which quaternary ammonium groups offer the positive charge for the cell-internalization of NPs, PBA groups serve for the formation of dynamic bonds in responding to pH change and mannitol addition, PVA furnishes the NPs with diol groups for the interaction with PBA groups and the formation of dynamic NPS, and Hep plays the roles of reducing the cytotoxicity of highly positively-charged chitosan and forming of complex NPs for DOX up-loading. A three-step fabrication process of drug-loaded NPs was described, and the characterization results were comprehensively demonstrated. The sustained drug release from the drug-loaded NPs displayed obvious pH and mannitol dependence. More specifically, the cumulative DOX release was increased more than 1.5-fold at pH 5.0 with 20 mg mL−1 mannitol. Furthermore, the nanoparticles were manifested with effective antitumor efficient and apparently enhanced cytotoxicity in response to the acidic pH value and/or mannitol.