The shutting down of countries due to the rapidly spreading COVID-19, which was announced as global pandemic on March 11, 2020, has disrupted the balance of social interaction and organization. In the effort to flatten the infection curve and reduce total fatalities from the disease, educational institutions are forced to shut down resulting educators grappling for other alternatives for delivering instructions. With urgency to maintain the continuity of the education systems, Malaysia has decided to implement Emergency Remote Teaching (ERT) to replace the withdrawal of face-to-face interaction at school during the Movement Control Order (MCO). This paper reviews the implementation of ER and teachers of primary education perception towards ERT in teaching English as second language (ESL) and challenges faced during the implementation of ERT. This paper also presents some recommendations in addressing the challenges identified to provide better implementation and quality delivery of knowledge through ERT.