Providing accurate real-time traffic information is an inherent problem for intelligent transportation systems (ITS). In order to improve the knowledge base of advanced driver assistance systems (ADAS), ITS are strongly concerned with data fusion techniques of all kinds of sensors deployed over the traffic network. Driver assistance is devoid of a comprehensive evidential reasoning system on contextual information, more specifically when a combination involves inside and outside sensory information of the driving environment. In this paper, we propose a novel agent-based evidential reasoning system using contextual information. Based on a series of information handling techniques, specifically, the belief functions theory and heuristic inference operations to achieve a consensus about daily driving activity in automatically inferring. That is quite different from other existing proposals, as it deals jointly with the driving behavior and the driving environment conditions. A case study including various scenarios of experiments is introduced to estimate behavioral information based on synthetic data for prediction, prescription, and policy analysis. Our experiments show promising, thought-provoking results encouraging further research.