This item was submitted to Loughborough's Institutional Repository (https://dspace.lboro.ac.uk/) by the author and is made available under the following Creative Commons Licence conditions.For the full text of this licence, please go to: http://creativecommons.org/licenses/by-nc-nd/2.5 / 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64
AbstractInformation about the design and construction of buildings can be structured in a particular way. This is especially correct given the increasing complexity of building product models and the emergence of Building Information Models with project documents linked to them. In addition, engineers usually have distinct information needs. Research shows that engineers working with Building Information Models place particular importance on the understanding of retrieved content before using it or applying it, and that exploration of context is essential for this understanding. Both these factors (the nature of engineering content and the information needs of engineers) make general information retrieval techniques for computing relevance and visualizing search results less applicable in civil engineering information retrieval systems. This paper argues that granularity is a fundamental concept that needs to be considered when measuring relevance and visualizing search results in information retrieval systems for repositories of building design and construction content. It is hypothesized that the design of systems with careful regard for granularity would improve engineers' relevance judgment behaviour. In order to test this hypothesis, a prototype system, called CoMem-XML, was developed and evaluated in terms of the time needed for users to find relevant information, the Manuscript (SECOND revised version) 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 Demian&d Balatsoukas, Ms. No. CPENG-318 resubmitted to JCCE, September 2010 2 accuracy of their relevance judgment and their subjective satisfaction with the prototype. A user study was conducted where test subjects were asked to complete tasks using various forms of the prototype, to complete a satisfaction questionnaire, and to be interviewed. The findings show that users perform better and are more satisfied when the search result interface of the CoMem-XML system presents only relevant information in context. On the other hand, interfaces that present the retrieved information out of context (i.e. without highlighting its position in the parts hierarchy) are less effective for participants to judge relevance.
KeywordsInformation retrieval, information management, knowledge management, search results, Building Information Modelli...