Corona Virus Disease 2019 (COVID-19) has developed into a global pandemic in the last two years, causing significant impacts on our daily life in many countries. Rapid and accurate detection of COVID-19 is of great importance to both treatments and pandemic management. Till now, a variety of point-of-care testing (POCT) approaches devices, including nucleic acid-based test and immunological detection, have been developed and some of them has been rapidly ruled out for clinical diagnosis of COVID-19 due to the requirement of mass testing. In this review, we provide a summary and commentary on the methods and biomedical devices innovated or renovated for the quick and early diagnosis of COVID-19. In particular, some of micro and nano devices with miniaturized structures, showing outstanding analytical performances such as ultra-sensitivity, rapidness, accuracy and low cost, are discussed in this paper. We also provide our insights on the further implementation of biomedical devices using advanced micro and nano technologies to meet the demand of point-of-care diagnosis and home testing to facilitate pandemic management. In general, our paper provides a comprehensive overview of the latest advances on the POCT device for diagnosis of COVID-19, which may provide insightful knowledge for researcher to further develop novel diagnostic technologies for rapid and on-site detection of pathogens including SARS-CoV-2.