Novel Focused Web Crawler For Anti Spaming Approach and Fast Query Retrieval

Abstract

The world wide web (WWW) is the major source of data and information organized in the form of interlinked hypertext pages. Knowledge seekers depend on this global source and hence, the role of traditional search engines is of immense importance. Traditional search engines bring the desired data and provide access to the information contained therein in response to user queries. newlineToday approximately 8 in every 10 persons are surfing the internet. It has taken a lot of concern because of the need and urge for information as well as for business purposes like e-banking, online transactions, etc. There is a significant boost in the number of internet surfers in the last ten years. newlineThe web pages are growing in a design of terabytes or even petabytes day by day. With such an abundance of growth of data, many factors vary in their performance. Among them are storage issues, uniform resource locator (URL) hit by spammers (called malicious URL), time taken to process query triggered by the user, returning of relevant data records in response to the fetched query, searching time etc. In the case of a small web, it is an easy task to answer a query whereas a robust modus operandi is needed for handling all these aspects in case of large volumes of data. newlineDue to enormous data in a web database, there are variations in results due to factors that are related to searching like ranking. Ranking of a web page depends on various factors like memory management, or storage issues, etc. during searching. But several factors like data structure used for storage purpose during searching, security, etc. affect the search engine results. newline