Inhibitors of the proteasome have been extensively studied for their applications in the treatment of human diseases such as hematologic malignancies, autoimmune disorders, and viral infections. Many of the proteasome inhibitors reported in the literature target the non-primed site of proteasome's substrate binding pocket. In this study, we designed, synthesized and characterized a series of novel α-keto phenylamide derivatives aimed at both the primed and non-primed sites of the proteasome. In these derivatives, different substituted phenyl groups at the head group targeting the primed site were incorporated in order to investigate their structure-activity relationship and optimize the potency of α-keto phenylamides. In addition, the biological effects of modifications at the cap moiety, P1、P2 and P3 side chain positions were explored. Many derivatives displayed highly potent biological activities in proteasome inhibition and anticancer activity against a panel of six cancer cell lines, which were further rationalized by molecular modeling analyses. Furthermore, a representative α-ketoamide derivative was tested and found to be active in inhibiting the cellular infection of SARS-CoV-2 which causes the COVID-19 pandemic. These results demonstrate that this new class of α-ketoamide derivatives are potent anticancer agents and provide experimental evidence of the anti-SARS-CoV-2 effect by one of them, thus suggesting a possible new lead to develop antiviral therapeutics for COVID-19.