Empirical Validation of Wireless Models in Simulations of Ad Hoc Routing Protocols

Abstract

Computer simulation has been used extensively as an effective tool in the design and evaluation of systems. One should not, however, underestimate the importance of validation-the process of ensuring whether a simulation model is an appropriate representation of the real-world system. Validation of wireless network simulations is difficult due to strong interdependencies among protocols at different layers and uncertainty in the wireless environment. The authors present an approach of coupling direct-execution simulation and traces from real outdoor experiments to validating simple wireless models that are used commonly in simulations of wireless ad hoc networks. This article documents a common testbed that supports direct execution of a set of ad hoc routing protocol implementations in a wireless network simulator. By comparing routing behavior measured in the real experiment with behavior computed by the simulation, the authors validate the models of radio behavior upon which protocol behavior depends.

Experimental Evaluation of Simulation Abstractions for Wireless Sensor Network MAC Protocols

“…Within this context, the work of Ivanov et al [1] and Liu et al [2] is most similar to our work. Ivanov compares the results of a real experiment with the results of the ns-2 wireless simulator for the same experiment, concluding that the simulated delivery ratio is quite accurate but latency results show much deviation from the real experiment.…”

Experimental validation of analytical performance models for IEEE 802.11 networks

“…get better validation results. There are earlier studies on the validation of analytical models and simulations against experimental testbeds [13], [14], [15], [16]. Ivanov et al [15] provide an experimental validation of a wireless model in ns-2 against a real network to show how well a model in ns-2 represents a real wireless network.…”

A metric for evaluating density level of wireless sensor networks

“…CRAWDAD [12] provides rich datasets originating from different real experimentations in various networking domains; one of them was conducted by Liu [13]. He used a test bed to have a practical outdoor comparison between different ad-hoc protocols.…”

“…We used the dataset generated by Liu [13] to show the effect of changing the number of neighboring nodes over Throughput. As nodes move, the number of direct connected neighbors changes, and is calculated through the SIN values, so that inactive nodes are excluded from the calculations.…”