Focused crawling of tagged web resources using ontology

Bedi, Punam; Thukral, Anjali; Banati, Hema

doi:10.1016/j.compeleceng.2012.09.009

Cited by 33 publications

(20 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In similar way A. Thukral et al [58] proposed Social Semantic Relevance (S2R) approach based on Vector Space Model which exploits relationship between tags and pre-existing semantics knowledge associated with tagged resources.…”

Section: Semantically Relevant Resource Retrieval and Ranking (Sr3)mentioning

confidence: 99%

A Literature Survey on Ranking Tagged Web Documents in Social Bookmarking Systems

Muhammad¹

2013

IOSR-JCE

View full text Add to dashboard Cite

Section: Semantically Relevant Resource Retrieval and Ranking (Sr3)mentioning

confidence: 99%

A Literature Survey on Ranking Tagged Web Documents in Social Bookmarking Systems

Muhammad¹

2013

IOSR-JCE

View full text Add to dashboard Cite

“…The ontology is basically a combination of taxonomy of the domain concepts and the relations between these concepts. Thus the ontology is used to expand the search topic semantically to give the relevance of the search topic with the web pages retrieved [4]. Thus the ontology plays an important role in relevance calculation.…”

Section: Introductionmentioning

confidence: 99%

Focused crawling with ontology using semi-automatic tagging for relevancy

Gaur

Sharma

2014

2014 Seventh International Conference on Contemporary Computing (IC3)

View full text Add to dashboard Cite

World Wide Web (WWW) is considered to be the most important source of information now a days but it's difficult to decide which resources are useful and which are more important. Thus to make a specific part of web leading to only the required resources is searched for. The focused crawler crawl a specific part of the web to retrieve the relevant resources. Here in this paper the focused crawler is applied on social network having ontology dependent tags. The ontology here is also used in preprocessing step of focused crawlers to make the search more specific by expanding the search topic semantically. Further the relevancy of manually tagged and semi-automatically tagged resource is compared. Then finally the harvest rate is evaluated for focused crawlers with ontology and using semi-automatic tagging to check for the relevance.

show abstract

“…The general purpose web crawlers, such as Heritrix [24], Nutch [25], and Labin [26], aim to download any web pages obtained through the hyperlinks, while focused web crawlers or topic-specific web crawlers intend to download as many web pages relevant to the given topic automatically and keep the amount of irrelevant web pages downloaded to the minimum [27,28]. Currently, web crawlers have been widely used in many fields, such as search engines, web data mining and business intelligence, etc., [28,29]. However, web crawlers are seldom used in geopolitical events analysis.…”

Section: Web Crawler Technologymentioning

confidence: 99%

Using Web Crawler Technology for Geo-Events Analysis: A Case Study of the Huangyan Island Incident

Hou

2014

Sustainability

View full text Add to dashboard Cite

Social networking and network socialization provide abundant text information and social relationships into our daily lives. Making full use of these data in the big data era is of great significance for us to better understand the changing world and the information-based society. Though politics have been integrally involved in the hyperlinked world issues since the 1990s, the text analysis and data visualization of geo-events faced the bottleneck of traditional manual analysis. Though automatic assembly of different geospatial web and distributed geospatial information systems utilizing service chaining have been explored and built recently, the data mining and information collection are not comprehensive enough because of the sensibility, complexity, relativity, timeliness, and unexpected characteristics of political events. Based on the framework of Heritrix and the analysis of web-based text, word frequency, sentiment tendency, and dissemination path of the Huangyan Island incident were studied by using web crawler technology and the text analysis. The results indicate that tag cloud, frequency map, attitudes pie, individual mention ratios, and dissemination flow graph, based on the crawled information and data processing not only highlight the characteristics of geo-event itself, but also implicate many interesting phenomenon and deep-seated problems behind it, such as related topics, theme vocabularies, subject contents, hot countries, event bodies, opinion leaders, high-frequency vocabularies, information sources, semantic structure, propagation paths, distribution of different attitudes, and regional difference of net citizens' response in the Huangyan Island incident. Furthermore, the text analysis of network information with the help of focused web crawler OPEN ACCESSSustainability 2014, 6 1897 is able to express the time-space relationship of crawled information and the information characteristic of semantic network to the geo-events. Therefore, it is a useful tool to collect information for understanding the formation and diffusion of web-based public opinions in political events.

show abstract

Focused crawling of tagged web resources using ontology

Cited by 33 publications

References 30 publications

A Literature Survey on Ranking Tagged Web Documents in Social Bookmarking Systems

A Literature Survey on Ranking Tagged Web Documents in Social Bookmarking Systems

Focused crawling with ontology using semi-automatic tagging for relevancy

Using Web Crawler Technology for Geo-Events Analysis: A Case Study of the Huangyan Island Incident

Contact Info

Product

Resources

About