51
Views
2
CrossRef citations to date
0
Altmetric
Cloud Computing for Big Data Processing

Evaluation of Search Engine Weight by Considering Repeated Web Page Contents

, &
Pages 589-597 | Published online: 11 May 2017
 

Abstract

The ranking of search results largely determines the quality of service (QoS) of a meta-search engine (MSE). To address the demand of big data applications, this paper proposes a new method considering factors such as network bandwidth, client and limit server resources. In this method, Web pages with the same contents (but with different URLs) are identified by calculating similarity among contents of pages traversed by the user and those of pages not yet traversed. Hence, deviation of statistics about the user’s intent for traversing caused by factors such as ranking differences in the orders of traversing and repeated contents of Web pages can be eliminated. While a search service is being provided, each component search engine (CSE) weight can be given dynamically before returned results receive a second rotary ranking in combination with initial ranking information. Experimental results and statistics show that (1) the numbers of traversals and downloads can be decreased; (2) the ratio of the number of pages clicked by the user to that of pages navigated can also be decreased; (3) the matching degree between searches/traversals and returned results can be increased; and (4) the stability of a search engine can be improved by taking into account the factor of repeated contents of Web pages.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access
  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart
* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.