Abstract-The needs for cheaper and less intrusive ways to collect activity-travel diaries led scientist to pursue new technologies, e.g., positioning technologies like GPS. While a fully, reliable and widely accepted automatic activity-travel diary collection system is yet to be developed, scientists have presented systems that automate parts of an activity-travel diary collection. In the advent of automated systems, it is important to discuss how to analyse the potential of such systems and how to compare different activity-travel diary collection systems. To achieve this objective, this paper introduces a parallel survey design and a comparison framework for collection systems. The framework can be used as a development tool to optimise system design, to report and monitor progress of different system designs, to objectively weigh benefits in decision making, and to automate systematic analysis. In particular, the framework can be used as a comparison tool to reveal the qualitative difference in the data gathered using different collection systems. To achieve this, the framework defines: 1) a number of activity-travel diary measurement entities (trips and triplegs), entity attributes (e.g., trip purpose, origin / destination, etc.), 2) similarity functions between instances of the same entities, and 3) spatial and temporal quality indices to establish a notion of ground truth. The utility of the proposed framework is demonstrated by analysing the results of a trial survey where data is collected via two activity-travel collection systems: a web-based system (PP) and a smartphone-app-based system (MEILI). PP was collected for one day period and MEILI was used for one week period (with one day overlapping). The results show that half of the trips are captured by both systems, while each system roughly captures the same number of trips as the other. The strengths and weaknesses of MEILI are analysed using the framework on the entire week dataset.