Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is responsible for the COVID-19 pandemic, whereas the influenza A virus (IAV) causes seasonal epidemics and occasional pandemics. Both viruses lead to widespread infection and death. SARS-CoV-2 and the influenza virus are RNA viruses. The SARS-CoV-2 genome is an approximately 30 kb, positive sense, 5′ capped single-stranded RNA molecule. The influenza A virus genome possesses eight single-stranded negative-sense segments. The RNA secondary structure in the untranslated and coding regions is crucial in the viral replication cycle. The secondary structure within the RNA of SARS-CoV-2 and the influenza virus has been intensively studied. Because the whole of the SARS-CoV-2 and influenza virus replication cycles are dependent on RNA with no DNA intermediate, the RNA is a natural and promising target for the development of inhibitors. There are a lot of RNA-targeting strategies for regulating pathogenic RNA, such as small interfering RNA for RNA interference, antisense oligonucleotides, catalytic nucleic acids, and small molecules. In this review, we summarized the knowledge about the inhibition of SARS-CoV-2 and influenza A virus propagation by targeting their RNA secondary structure.