Please use this identifier to cite or link to this item:
Title: Design of a hidden web crawler based search engine
Researcher: Anuradha
Guide(s): Sharma, A K
Keywords: Computer Engineering
web crawler
search engine
Upload Date: 28-Mar-2013
University: Maharshi Dayanand University
Completed Date: October 2011
Abstract: The World Wide Web is a global information medium of interlinked hypertext documents accessed via computers connected to the internet. Most of the users rely on traditional search engines to search the information on the web. These search engines deal with the Surface Web which is a set of Web pages directly accessible through hyperlinks and ignores a large part of the Web called Hidden Web which is hidden to present-day search engines. It lies behind search forms and this part of the web containing an almost endless amount of sources providing high quality information stored in specialized databases, can be found in the depths of the WWW. World Wide Web (WWW) is broadly divided into two categories: and#61472;The surface web contains 1% of information content of the web. Search engine crawl along the web to extract and index text from HTML documents on the websites, then make this information searchable through keywords. and#61472;The hidden web contains 99% of information content of the web. Most of this information is contained in the databases and is not indexed by search engines. This means if we are searching for information from surface web only, we search through only 1% of WWW and miss 99% of it whereas 95% of hidden web is free publicly accessible information. As the Hidden web information that is hidden behind the search query forms can only be accessed by interacting with these forms, development of automated system that interacts with the search forms and extracts the hidden web content would be of great value to human users. Today, the web is crowded with home-pages and sites that sell various types of products. Since the companies selling same type of products are not at all interested to publish the products of their competitors on their site, it would be nice if there is a free web service which collaborate the marketing of the products of the competitor web sites. Infact all the information is available on the internet but buried behind search interfaces and stored inside the databases.
Pagination: 148p.
Appears in Departments:Department of Computer Science

Files in This Item:
File Description SizeFormat 
01_title.pdfAttached File34.1 kBAdobe PDFView/Open
02_certificate.pdf10.32 kBAdobe PDFView/Open
03_declaration.pdf9.91 kBAdobe PDFView/Open
04_acknowledgements.pdf12.99 kBAdobe PDFView/Open
05_dedication.pdf8.87 kBAdobe PDFView/Open
06_abstract.pdf17.33 kBAdobe PDFView/Open
07_contents.pdf16.6 kBAdobe PDFView/Open
08_list of figures.pdf19.72 kBAdobe PDFView/Open
09_list of tables.pdf9.45 kBAdobe PDFView/Open
10_chapter 1.pdf1.27 MBAdobe PDFView/Open
11_chapter 2.pdf198.38 kBAdobe PDFView/Open
12_chapter 3.pdf366.93 kBAdobe PDFView/Open
13_chapter 4.pdf31.29 kBAdobe PDFView/Open
14_chapter 5.pdf1.2 MBAdobe PDFView/Open
15_chapter 6.pdf2.59 MBAdobe PDFView/Open
16_chapter 7.pdf14.93 kBAdobe PDFView/Open
17_bibliography.pdf62.5 kBAdobe PDFView/Open
18_appendix.pdf172.06 kBAdobe PDFView/Open

Items in Shodhganga are protected by copyright, with all rights reserved, unless otherwise indicated.