Road scene analysis is a wide domain of research that aims to ameliorate the environmental perception in intelligent transportation systems, including autonomous vehicles and advanced driver-assistance systems. It also plays a crucial role in road safety improvement, by contributing to the reduction of traffic accidents' rate. Ensuring an efficient recognition of traffic signs contributes enormously to making cars safer, which in consequence helps to save more lives on roads. To ensure this recognition, many approaches are adopted, especially deep learning ones and more specifically convolutional neural networks. In effect, these networks have proven their high performances in many fields of computer vision research, including traffic sign recognition. However, although their high performances, many limitations still face their implementation, especially in real-time applications and resource-constrained environments. From this perspective, creating a certain balance between the model complexity and the classification accuracy, through a computationally efficient network, is the main objective of this study. To achieve this goal, a receptive fields architecture is adopted to preserve and optimize the connectivity between the different units of the network. Based on this architecture, two receptive field networks are proposed, with reduced complexity and enhanced generalizability. Using two public datasets, the obtained results show that the adopted approach ensures high classification accuracies and considerably accelerates the inference stage. The obtained accuracy is about 98.49%, using the Belgium traffic signs classification dataset, while the inference time is less than 500 us per image.