Designing and Implementing Web Mining Techniques

Abstract

Web mining is referred to as the application of the techniques of data mining which are used to discover the patterns from the World Wide Web. It generally uses automated techniques to extract both structured as well as unstructured data from the web pages, link structures, and server logs. The techniques of Web Mining are web structure mining, web usage mining and web content mining. Most companies, government, and individuals put information on the web with the help of the internet. This is becoming popular nowadays. Summarization is considered the key concept of data mining that engages the method for finding the compact explanation of the dataset. Automatic summarization is known as the procedure of shortening the dataset computationally to generate a subset that presents the most significant or related information in the original content. Additionally, videos, images and text also can be summarized. The main objective of automatic document summarization is to make a precise and proper summarization of a document. The architecture of the system of summarization includes transformation, generation, and interpretation. newlineVarious techniques have been presented in the research work to create the summary. The techniques are the creation of the single document summary with the help of calculation of the Pointwise Mutual information for every sentence of the document, the creation of the single document summary with the help of Coverage Aware Enriched Dragonfly-EL Single Document Summarization, and summary of multi-document text summarization utilizing the approach of dolphin swarm optimization. All these techniques which were mentioned above have been described in-depth within this research work. The Pointwise Mutual Information technique is used to calculate pointwise mutual information between consecutive words of each sentence and calculates the entire PMI of each sentence. newlineDolphin swarm optimization has to take the critical benefit of echolocation as well as implement various strategies for obtain