Searching the web: The public and their queries

Spink, Amanda; Wolfram, Dietmar; Jansen, Major B. J.; Saračević, Tefko

doi:10.1002/1097-4571(2000)9999:9999<::aid-asi1591>3.0.co;2-r

Cited by 659 publications

(433 citation statements)

References 18 publications

Supporting

Mentioning

394

Contrasting

Unclassified

Order By: Relevance

“…There is also active research on the types of queries users input to search engines (Spink et al 2001, Jansen et al 2000. For example Spink et al (2001) study over a million queries posed to the Excite search engine and find that the language of Web queries is distinctive in that a great many terms are unique.…”

Section: Characterization Of Topicsmentioning

confidence: 99%

See 1 more Smart Citation

A General Evaluation Framework for Topical Crawlers

2005

View full text Add to dashboard Cite

Topical crawlers are becoming important tools to support applications such as specialized Web portals, online searching, and competitive intelligence. As the Web mining field matures, the disparate crawling strategies proposed in the literature will have to be evaluated and compared on common tasks through well-defined performance measures. This paper presents a general framework to evaluate topical crawlers. We identify a class of tasks that model crawling applications of different nature and difficulty. We then introduce a set of performance measures for fair comparative evaluations of crawlers along several dimensions including generalized notions of precision, recall, and efficiency that are appropriate and practical for the Web. The framework relies on independent relevance judgements compiled by human editors and available from public directories. Two sources of evidence are proposed to assess crawled pages, capturing different relevance criteria. Finally we introduce a set of topic characterizations to analyze the variability in crawling effectiveness across topics. The proposed evaluation framework synthesizes a number of methodologies in the topical crawlers literature and many lessons learned from several studies conducted by our group. The general framework is described in detail and then illustrated in practice by a case study that evaluates four public crawling algorithms. We found that the proposed framework is effective at evaluating, comparing, differentiating and interpreting the performance of the four crawlers. For example, we found the IS crawler to be most sensitive to the popularity of topics.

show abstract

Section: Characterization Of Topicsmentioning

confidence: 99%

“…For example Spink et al (2001) study over a million queries posed to the Excite search engine and find that the language of Web queries is distinctive in that a great many terms are unique.…”

Section: Characterization Of Topicsmentioning

confidence: 99%

A General Evaluation Framework for Topical Crawlers

2005

View full text Add to dashboard Cite

show abstract

“…* Kazuyuki Ito ito@hosei.ac.jp 1 Hosei University, Koganei, Japan 2 Hitachi Industry & Control Solutions, Ltd., Hitachi, Japan 3 NEC Communication Systems, Ltd., Minato, Japan ingredients in the refrigerator. In other words, the proposed search engine identifies various desirable combinations of dishes that can be cooked using the existing food items in the refrigerator and shows their recipes.…”

Section: Introductionmentioning

confidence: 99%

“…However, a conventional, keyword-based search engine is not effective for such a system, making the system inefficient to search for recipes that can be cooked using only the ingredients in the refrigerator [2,3].…”

mentioning

confidence: 99%

Meal plan search engine inspired by ant colony’s foraging

Ito

Kim

Tachibana

2015

Artif Life Robotics

View full text Add to dashboard Cite

mobile phones, consumer electrical appliances, and other information devices, we observe a continuous improvement in the quality of consumer services. This environment, known as "Ubiquitous computing" or "Smart home appliance," has the potential for further development [1].Smart home appliances such as the refrigerator not only keep food fresh, but also manage information about food ingredients, act as a search engine for recipes, and communicate with the "digital kitchen". Such digital collaboration among appliances and other information devices is a leading example of this environment.However, a conventional, keyword-based search engine is not effective for such a system, making the system inefficient to search for recipes that can be cooked using only the ingredients in the refrigerator [2,3].In this paper, we propose a system that recommends meal plans and recipes that can be cooked using only the available food items in the refrigerator. To realize this new search engine, we focus on the mechanism of an ant colony's foraging [4][5][6]. It is reported that ants repeat simple actions such as "lifting up", "carrying", and "lifting down," and the ant colonies make food clusters. The food clusters are built randomly, and therefore, the size and place of each cluster is different.In the proposed search engine, we consider the food items in the refrigerator to be the ants' food and the cookable dishes to be the ants' food clusters. Hence, the search engine (for meal plans) represents an ant colony's foraging in the virtual world. We also validate the effectiveness of the proposed search engine by performing simulations. Goals of the proposed systemThe proposed system recommends meal plans and recipes that can be cooked only using the available food Abstract Currently, the communication link between consumer electrical appliances and information devices is developing; for example, a refrigerator, which keeps food fresh, now also manages information about the food ingredients it contains. This environment, known as "Ubiquitous computing" or "Smart home appliance," has the potential for further research and development. In this environment, we consider a system that recommends food recipes or meal plans that can be cooked with the available ingredients in the refrigerator. However, a conventional keyword search is not effective for such a system, and therefore, in this paper, we propose an algorithm for the search engine that is inspired by an ant colony's foraging. In addition, we validate the effectiveness of the proposed search engine through simulations.

show abstract

“…A number of studies of search engine queries have observed a high misspelling rate (Nordlie, 1999;Spink et al, 2001;Wang et al, 2003). Wang et al (2003) report a misspelling rate of 26% for words on an academic site.…”

Section: Introductionmentioning

confidence: 99%

Spelling correction in the PubMed search engine

2006

View full text Add to dashboard Cite

It is known that users of internet search engines often enter queries with misspellings in one or more search terms. Several web search engines make suggestions for correcting misspelled words, but the methods used are proprietary and unpublished to our knowledge. Here we describe the methodology we have developed to perform spelling correction for the PubMed search engine. Our approach is based on the noisy channel model for spelling correction and makes use of statistics harvested from user logs to estimate the probabilities of different types of edits that lead to misspellings. The unique problems encountered in correcting search engine queries are discussed and our solutions are outlined.

show abstract

Searching the web: The public and their queries

Cited by 659 publications

References 18 publications

A General Evaluation Framework for Topical Crawlers

A General Evaluation Framework for Topical Crawlers

Meal plan search engine inspired by ant colony’s foraging

Spelling correction in the PubMed search engine

Contact Info

Product

Resources

About