Electrophysiological Source Imaging (ESI) methods are hampered by the lack of "gold standards" for model comparison. Concurrent electroencephalography (EEG) and electrocorticography (ECoG) recordings (namely EECoG) are considered gold standard to validating EEG generative models with primate models have the unique advantages of both flexibility and translational value in human research. However the severe EEG artifacts during such invasive experiments, the complexity of providing sufficiently detailed biophysical models, as well as lacking sound statistical connectivity comparison methods have hampered the availability and analysis of such datasets. In this paper, 1) we provide EECoG-Comp: an open source platform (https://github.com/Vincent-wq/EECoG-Comp) which encompasses the preprocessing, forward modeling, simulation and comparison module; 2) we take the simultaneous EECoG dataset from www.neurotycho.org as an example to illustrate the use of this platform and compare the source connectivity estimation performance of 4 popular ESI methods named MNE, LCMV, eLORETA and SSBL. The conclusion shows the limits of performance of these ESI connectivity estimators using both simulations and real data analysis. In fact, the use of this platform also suggests the need for both improved simultaneous EEG and ECoG experiments and ESI connectivity estimators.2 Noteworthily, more recent and realistic phantoms, even 3D printed, are now available for these tests (Collier et al., 2012; Li et. Al 2013; Zhang et al. 2013). source setting are: , rand ESI H,eeg,Θ J (human EEG with different ESI methods) and , ,, rand ESI rand ESI M,eeg,Θ M,ecog,Θ J J (monkey EEG and ECoG source activities estimated from different ESI methods), and the source estimators for the block source setting are , block ESI H,eeg,Θ J (human EEG with different ESI methods) and , ,, block ESI block ESI M,eeg,Θ M,ecog,Θ J J (monkey EEG and ECoG source activities estimated from different ESI methods). With this simulation, we have both the "ground truth" source activities , rand block Θ Θ J J with the "ground truth" source connecitivity , rand block as connectivity, and their corresponding estimators from human EEG, monkey EEG and monkey ECoG simulations with different number of sources, different number of sensors and different ESI methods. Before further analysis, we bandpass all the estimated source activation to 8-12Hz and limit the connectivity estimations to alpha band. In order to compare connectivity from different ESI results, we use graphical LASSO (Hsieh et al. 2014) to reconstruct the connectivity estimators (ˆ, rand block ) and compare them with the tools provided by EECoG_conComp. Notice that, for the source activities, we have the "ground truth" , rand block Θ Θ J J , and we can estimate the source connectivity from them without applying any ESI methods, which is taken as the basic performance to compared against. Finally, we summaize the simulation results with Performance Improvement Ratio ( PIR ESI ) of a specific ESI method, which is d...