The phytochemical constituents of Calligonum tetrapterum Jaub. & Spach (Family Polygonaceae) were studied for the first time. The study resulted in the isolation of the rare flavonol glycoside, kaempferol 3-O-(6″-O-acetyl)-glucoside,(K3G-A). The potential inhibitive activity of K3G-A toward SARS-CoV-2 was investigated utilizing several in silico approaches. First, molecular fingerprints and structural similarity experiments were carried out for K3G-A against nine co-crystallized ligands of nine proteins of SARS-CoV-2 to reveal if there is a structural similarity with any of them. The conducted studies showed the high similarity of K3G-A and remdesivir, the co-crystallized ligand of SARS-CoV-2 RNA-dependent RNA polymerase (PDB ID: 7BV2), RdRp. To validate these findings, a DFT study was conducted and confirmed the proposed similarity on the electronic and orbital levels. The binding of K3G-A against RdRp was confirmed through molecular docking studies exhibiting a binding energy of −27.43 kcal/mol, which was higher than that of remdesivir. Moreover, the RdRp-K3G-A complex was subjected to several MD studies at 100 ns that authenticated the accurate mode of binding and the correct dynamic behavior. Finally, in silico ADMET and toxicity evaluation of K3G-A was conducted and denoted the safety and the drug-likeness of K3G-A. In addition to K3G-A, two other metabolites were isolated and identified to be kaempferol (K) and β-sitosterol (β-S).