The COVID-19 pandemic brought about many critical issues in all aspects such as economy, environment, health, and lifestyle, but people always try to find some response to crisis in different conditions. E-learning is defined as an elaborate response aiming at continuing education during the COVID-19 pandemic. It seems that developed countries have established and adjusted their technological infrastructures for the transition from a face-to-face education to a digital one. In contrast, developing countries were not completely prepared for this transition. Improper and deficient technological and practical fundamentals have been causing problems for all students, instructors, and other involved individuals. Therefore, we reviewed the challenges that have arisen from e-learning during the COVID-19 outbreak in different parts of tertiary education focusing on underprivileged countries.