This research introduces a comprehensive study of the most robust Single-Board Computers (SBCs) implemented recently, where most of them are built on the system-on-chip architecture. This study also presents the main characteristics of each of these SBCs, as well as their prices and applications. Additionally, the study reviews some machine learning (ML) and deep learning (DL) techniques, exploring their implementation on SBCs. Finally, it displays some software tools on how to implement DL and ML projects on SBCs.