Blood glucose detecting has aroused considerable attention because diabetes mellitus has become a worldwide publish health problem. Herein, we construct an exceptionally simple upconverting hybrid nanocomposite, composed of DNA-templated Ag nanoparticles (DNA-AgNPs) and NaYF4:Yb/Tm@NaYF4 core-shell upconversion nanoparticles (UCNPs), for the sensing of H2O2 and glucose. In this design, UCNPs with bared surface act as the donor, and DNA-AgNPs serve as efficient quenchers. DNA-AgNPs can be directly assembled on the bared surface of UCNPs, which further decreases the distance of donor-to-acceptor. The formation of DNA-AgNPs/UCNP nanocomposite results in luminescence quenching of UCNP by DNA-AgNPs through luminescence resonance energy transfer (LRET). Upon H2O2 addition, AgNPs can be etched and transformed into Ag(+), leading to inhibition of the LRET process and causing the recovery of upconversion luminescence. Based on the conversion of glucose into H2O2 by glucose oxidase, the DNA-AgNPs/UCNP nanocomposite can also be exploited for glucose sensing. Moreover, due to the non-autofluorescence offered by UCNPs, the approach developed can be applied to monitor glucose levels in human serum samples with satisfactory results.